Jun 12 18:21:50.301886 ip-10-0-135-194 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:21:50.752920 ip-10-0-135-194 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:21:50.752920 ip-10-0-135-194 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:21:50.752920 ip-10-0-135-194 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:21:50.752920 ip-10-0-135-194 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:21:50.752920 ip-10-0-135-194 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:21:50.754118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.753916 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:21:50.758504 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758483 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:50.758504 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758505 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758509 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758512 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758515 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758518 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758521 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758523 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758526 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758529 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758532 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758535 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758537 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758540 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758543 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758545 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758551 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758556 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758560 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758563 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:50.758593 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758566 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758569 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758587 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758591 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758593 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758596 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758601 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758605 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758609 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758612 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758615 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758617 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758620 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758623 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758632 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758635 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758637 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758640 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758643 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758645 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:50.759051 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758648 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758650 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758653 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758656 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758658 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758661 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758664 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758667 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758670 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758672 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758674 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758677 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758679 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758682 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758686 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758689 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758691 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758694 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758697 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758699 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:50.759634 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758702 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758704 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758707 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758709 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758712 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758715 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758718 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758720 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758723 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758726 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758728 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758731 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758733 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758736 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758738 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758741 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758743 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758746 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758749 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758751 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:50.760136 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758756 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758760 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758764 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758767 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758770 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758773 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758775 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758778 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758781 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758783 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758786 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758789 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758792 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758794 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758796 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758799 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758802 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758804 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.758807 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:50.760637 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759538 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759547 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759550 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759553 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759556 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759559 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759562 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759565 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759568 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759570 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759590 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759595 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759600 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759603 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759609 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759612 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759615 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759618 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759621 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:50.761095 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759624 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759626 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759629 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759632 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759635 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759637 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759640 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759642 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759645 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759648 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759651 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759653 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759656 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759659 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759661 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759664 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759666 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759669 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759671 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759674 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:50.761561 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759676 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759680 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759682 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759685 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759688 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759691 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759693 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759696 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759699 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759701 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759704 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759706 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759709 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759712 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759715 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759717 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759720 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759722 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759725 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:50.762069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759729 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759732 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759735 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759737 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759740 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759742 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759745 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759748 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759751 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759754 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759757 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759761 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759764 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759767 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759769 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759772 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759775 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759778 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759781 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759784 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:50.762530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759786 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759789 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759793 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759796 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759799 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759806 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759809 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759812 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759815 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759818 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759821 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759823 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759826 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759828 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759831 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759834 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759836 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759839 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759842 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759846 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:50.763037 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.759849 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760215 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760220 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760222 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760225 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760227 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760230 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760233 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760235 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760238 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760241 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760243 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760246 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760256 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760261 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760263 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760266 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760271 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760274 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760276 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:50.763530 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760279 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760281 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760284 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760286 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760289 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760293 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760296 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760298 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760301 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760303 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760306 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760309 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760312 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760315 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760317 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760320 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760322 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760324 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760327 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:50.764069 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760329 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760332 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760334 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760336 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760339 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760342 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760344 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760347 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760350 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760352 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760356 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760358 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760361 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760363 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760366 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760368 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760371 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760373 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760376 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760379 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:50.764538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760381 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760384 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760386 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760389 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760392 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760395 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760398 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760401 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760403 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760406 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760410 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760414 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760417 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760421 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760424 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760427 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760430 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760433 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760435 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:50.765044 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760438 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760440 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760444 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760449 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760451 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760454 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760456 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760459 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760461 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760464 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760467 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760469 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760472 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760474 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760477 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760479 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760482 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760484 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760487 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760489 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:50.765539 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760492 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.760494 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760563 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760570 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760591 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760596 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760600 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760603 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760607 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760612 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760615 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760618 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760621 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760624 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760628 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760633 2557 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760636 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760639 2557 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760642 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760645 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760649 2557 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760652 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760655 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760659 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:21:50.766032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760662 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760665 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760668 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760671 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760675 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760678 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760681 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760684 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760687 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760690 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760694 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760697 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760700 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760703 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760706 2557 flags.go:64] FLAG: --enable-server="true" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760709 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760714 2557 flags.go:64] FLAG: --event-burst="100" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760717 2557 flags.go:64] FLAG: --event-qps="50" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760720 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760723 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760727 2557 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760731 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760734 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760737 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760742 2557 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:21:50.766625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760745 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760748 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760751 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760753 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760756 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760759 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760762 2557 flags.go:64] FLAG: --feature-gates="" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760766 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760769 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760772 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760775 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760780 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760783 2557 flags.go:64] FLAG: --help="false" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760786 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-135-194.ec2.internal" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760789 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760792 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760795 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760799 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760802 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760805 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760808 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760811 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760813 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:21:50.767259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760816 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760819 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760822 2557 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760825 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760828 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760831 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760834 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760837 2557 flags.go:64] FLAG: --lock-file="" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760841 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760844 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760847 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760853 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760855 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760858 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760861 2557 flags.go:64] FLAG: --logging-format="text" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760864 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760867 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760870 2557 flags.go:64] FLAG: --manifest-url="" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760873 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760877 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760881 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760894 2557 flags.go:64] FLAG: --max-pods="110" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760897 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760900 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760903 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:21:50.767879 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760907 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760910 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760912 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760915 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760922 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760925 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760928 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760931 2557 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760934 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760940 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760943 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760946 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760949 2557 flags.go:64] FLAG: --port="10250" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760952 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760955 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d44b2072e72a5539" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760959 2557 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760962 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760965 2557 flags.go:64] FLAG: --register-node="true" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760968 2557 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760972 2557 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760975 2557 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760978 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760980 2557 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760984 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760987 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:21:50.768494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760990 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760993 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.760997 2557 flags.go:64] FLAG: --runonce="false" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761000 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761003 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761006 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761009 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761012 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761015 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761018 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761021 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761025 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761027 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761030 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761033 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761036 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761039 2557 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761041 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761047 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761049 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761052 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761056 2557 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761059 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761062 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761065 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:21:50.769139 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761068 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761071 2557 flags.go:64] FLAG: --v="2" Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761075 2557 flags.go:64] FLAG: --version="false" Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761079 2557 flags.go:64] FLAG: --vmodule="" Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761082 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.761085 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761552 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761557 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761561 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761565 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761569 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761584 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761589 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761592 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761595 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761597 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761600 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761603 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761605 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761608 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761610 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:50.769767 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761613 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761615 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761618 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761622 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761626 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761629 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761632 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761635 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761639 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761641 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761644 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761647 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761650 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761652 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761655 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761657 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761660 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761662 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761665 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761667 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:50.770281 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761672 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761674 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761677 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761679 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761682 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761684 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761687 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761689 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761692 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761695 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761697 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761700 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761702 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761705 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761708 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761710 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761712 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761715 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761718 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761720 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:50.771058 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761724 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761728 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761732 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761735 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761738 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761741 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761744 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761747 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761749 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761752 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761755 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761758 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761762 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761765 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761768 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761770 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761773 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761775 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761778 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:50.771847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761780 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761783 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761785 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761788 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761790 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761793 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761795 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761798 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761800 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761803 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761805 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761808 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761810 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761814 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761817 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761819 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761822 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761824 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761827 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761830 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:50.772336 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761832 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761835 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761837 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761840 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.761842 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.764012 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.771836 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.771895 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.772086 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.772101 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772172 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772179 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772183 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772186 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772189 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:50.772855 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772192 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772195 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772198 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772201 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772204 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772206 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772209 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772212 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772214 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772219 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772223 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772226 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772229 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772232 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772235 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772238 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772241 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772245 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772255 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:50.773240 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772261 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772264 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772270 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772275 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772278 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772281 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772284 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772287 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772290 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772293 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772296 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772299 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772301 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772304 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772306 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772309 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772312 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772314 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772317 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772320 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:50.773717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772322 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772325 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772327 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772330 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772332 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772335 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772338 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772340 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772343 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772347 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772350 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772352 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772355 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772357 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772360 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772363 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772366 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772368 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772372 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772375 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:50.774212 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772378 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772380 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772383 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772386 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772388 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772391 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772393 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772396 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772398 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772401 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772403 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772406 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772409 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772411 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772413 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772416 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772419 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772421 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772424 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:50.774729 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772426 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772429 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772431 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772434 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772436 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772439 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772441 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772444 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772446 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772449 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772452 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772455 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772458 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772461 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772463 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:50.775184 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772466 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.772471 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772614 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772621 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772624 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772628 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772630 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772634 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772636 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772639 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772642 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772644 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772647 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772650 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772654 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:50.775541 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772656 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772659 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772662 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772664 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772667 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772670 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772672 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772674 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772677 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772680 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772682 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772685 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772689 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772692 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772696 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772698 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772701 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772704 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772707 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772709 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:50.775926 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772712 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772714 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772717 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772719 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772722 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772724 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772727 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772730 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772732 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772735 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772737 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772740 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772743 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772745 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772748 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772751 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772753 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772756 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772758 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772761 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:50.776414 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772763 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772765 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772768 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772770 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772773 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772775 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772779 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772782 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772785 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772788 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772791 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772795 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772797 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772800 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772803 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772806 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772808 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772811 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772813 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:50.776954 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772816 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772818 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772821 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772823 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772826 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772829 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772832 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772835 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772837 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772840 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772843 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772845 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772848 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772850 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772853 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772857 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772861 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772864 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772866 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772870 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:50.777405 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772872 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772875 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772877 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772880 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772882 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772885 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:50.772888 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.772893 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.773031 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:21:50.777988 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.776799 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:21:50.779248 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.779235 2557 server.go:1019] "Starting client certificate rotation" Jun 12 18:21:50.779358 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.779341 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:21:50.779388 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.779383 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:21:50.782769 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.782755 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:21:50.784800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.784783 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:21:50.798559 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.798541 2557 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:21:50.801829 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.801813 2557 log.go:25] "Validated CRI v1 image API" Jun 12 18:21:50.802639 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.802622 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:21:50.805734 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.805714 2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e129c097-b6e9-412b-a3e8-dc86d566f363:/dev/nvme0n1p4 fd412905-70f7-4fd5-b43a-f20d12d3761b:/dev/nvme0n1p3] Jun 12 18:21:50.805798 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.805732 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:21:50.806084 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.806065 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:21:50.811884 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.811772 2557 manager.go:216] Machine: {Timestamp:2026-06-12 18:21:50.81038116 +0000 UTC m=+0.379669582 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099449 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f31856c9f28f2ab562971d3398d10 SystemUUID:ec2f3185-6c9f-28f2-ab56-2971d3398d10 BootID:2a50c6b8-52f2-4810-8e5b-fa744db00801 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:09:97:f6:35 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:09:97:f6:35 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:ea:e2:c8:a5:9d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:21:50.811884 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.811881 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:21:50.812009 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.811965 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:21:50.813206 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.813179 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:21:50.813344 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.813208 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-194.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:21:50.814924 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.814913 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:21:50.814959 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.814926 2557 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:21:50.814959 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.814934 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:21:50.815659 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.815648 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:21:50.817082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.817071 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:21:50.820810 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.820797 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:21:50.820931 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.820922 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:21:50.820964 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.820955 2557 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:21:50.820991 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.820971 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:21:50.820991 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.820985 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:21:50.821043 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.820995 2557 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:21:50.821043 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.821003 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:21:50.821415 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.821403 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:21:50.822079 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.821422 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:21:50.826256 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.826235 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:21:50.827930 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.827915 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:21:50.827994 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.827945 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:21:50.828106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.828097 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:21:50.828140 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.828111 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:21:50.828140 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.828118 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:21:50.828140 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.828124 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:21:50.828140 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.828131 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:21:50.828140 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.828138 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:21:50.830004 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.829993 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:21:50.830004 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830004 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:21:50.830083 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830011 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:21:50.830083 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830017 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:21:50.830083 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830025 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:21:50.830083 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830033 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:21:50.830837 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830820 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kfgm" Jun 12 18:21:50.830897 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830852 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:21:50.830897 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.830860 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:21:50.832653 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.832630 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-194.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 18:21:50.832653 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.832638 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:21:50.834392 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.834376 2557 server.go:1268] "Started kubelet" Jun 12 18:21:50.834462 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.834441 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:21:50.834512 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.834455 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:21:50.834553 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.834535 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:21:50.835360 ip-10-0-135-194 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:21:50.835998 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.835943 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-194.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 18:21:50.836704 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.836684 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kfgm" Jun 12 18:21:50.837000 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.836980 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:21:50.837259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.837246 2557 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:21:50.842370 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.842346 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:21:50.844205 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.844185 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:21:50.844315 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.844260 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:21:50.844315 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.844284 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:50.844951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.844888 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:21:50.844951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.844909 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:21:50.844951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.844929 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:21:50.845106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845040 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:21:50.845106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845050 2557 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:21:50.845106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845060 2557 factory.go:55] Registering systemd factory Jun 12 18:21:50.845106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845076 2557 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:21:50.845310 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845293 2557 factory.go:153] Registering CRI-O factory Jun 12 18:21:50.845310 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845311 2557 factory.go:223] Registration of the crio container factory successfully Jun 12 18:21:50.845420 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845391 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:21:50.845475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845431 2557 factory.go:103] Registering Raw factory Jun 12 18:21:50.845475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.845445 2557 manager.go:1196] Started watching for new ooms in manager Jun 12 18:21:50.846085 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.846070 2557 manager.go:349] Starting recovery of all containers Jun 12 18:21:50.846605 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.846056 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:50.848373 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.848350 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-194.ec2.internal\" not found" node="ip-10-0-135-194.ec2.internal" Jun 12 18:21:50.858920 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.858901 2557 manager.go:354] Recovery completed Jun 12 18:21:50.860302 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.860276 2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 12 18:21:50.863207 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.863194 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:50.865090 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865068 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:50.865187 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865109 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:50.865187 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865122 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:50.865643 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865629 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:21:50.865685 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865644 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:21:50.865685 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865665 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:21:50.865685 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.865678 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:50.866450 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.866433 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:50.866512 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.866464 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:50.866512 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.866479 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:50.866920 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.866910 2557 policy_none.go:49] "None policy: Start" Jun 12 18:21:50.866953 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.866931 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:21:50.866953 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.866941 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:21:50.868113 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.868102 2557 policy_none.go:47] "Start" Jun 12 18:21:50.903211 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903194 2557 manager.go:337] "Starting Device Plugin manager" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.903237 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903251 2557 server.go:87] "Starting device plugin registration server" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903544 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903560 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903716 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903812 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.903825 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.904610 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.904649 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.909848 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.911004 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.911046 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.911073 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:50.911158 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 18:21:50.913570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:50.912647 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:51.004093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.004015 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:51.005157 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.005139 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:51.005263 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.005175 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:51.005263 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.005189 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:51.005263 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.005214 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.012211 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.012190 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal"] Jun 12 18:21:51.012286 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.012254 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:51.013039 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.013022 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:51.013113 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.013050 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:51.013113 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.013060 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:51.014275 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.014263 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:51.014366 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.014345 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.014417 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.014379 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-194.ec2.internal\": node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.014467 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.014420 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.014467 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.014463 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:51.015026 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.015010 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:51.015106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.015036 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:51.015106 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.015051 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:51.018309 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.018291 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:51.018406 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.018323 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:51.018406 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.018334 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:51.020165 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.020151 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.020224 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.020181 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:51.020922 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.020905 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:51.021026 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.021016 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:51.021075 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.021033 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:51.030218 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.030197 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-194.ec2.internal\" not found" node="ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.030360 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.030346 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.035616 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.035599 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-194.ec2.internal\" not found" node="ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.046934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.046913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/430e56300c428255359659417cc0d456-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal\" (UID: \"430e56300c428255359659417cc0d456\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.047026 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.046940 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/430e56300c428255359659417cc0d456-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal\" (UID: \"430e56300c428255359659417cc0d456\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.047026 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.046959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cee66534c8a708e52ad6bf5e42247133-config\") pod \"kube-apiserver-proxy-ip-10-0-135-194.ec2.internal\" (UID: \"cee66534c8a708e52ad6bf5e42247133\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.130873 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.130840 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.147953 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.147925 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cee66534c8a708e52ad6bf5e42247133-config\") pod \"kube-apiserver-proxy-ip-10-0-135-194.ec2.internal\" (UID: \"cee66534c8a708e52ad6bf5e42247133\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.147953 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.147956 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/430e56300c428255359659417cc0d456-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal\" (UID: \"430e56300c428255359659417cc0d456\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.148118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.147974 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/430e56300c428255359659417cc0d456-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal\" (UID: \"430e56300c428255359659417cc0d456\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.148118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.148033 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/430e56300c428255359659417cc0d456-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal\" (UID: \"430e56300c428255359659417cc0d456\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.148118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.148063 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cee66534c8a708e52ad6bf5e42247133-config\") pod \"kube-apiserver-proxy-ip-10-0-135-194.ec2.internal\" (UID: \"cee66534c8a708e52ad6bf5e42247133\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.148118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.148074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/430e56300c428255359659417cc0d456-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal\" (UID: \"430e56300c428255359659417cc0d456\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.231392 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.231340 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.332139 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.332063 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.333153 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.333140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.341569 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.341545 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" Jun 12 18:21:51.432962 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.432921 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.533442 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.533406 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.633997 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.633919 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.734464 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.734428 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.777913 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.777885 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:21:51.778467 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.778060 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:21:51.778467 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.778058 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:21:51.835442 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.835407 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:51.839137 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.839109 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:16:50 +0000 UTC" deadline="2028-03-03 22:15:51.284136412 +0000 UTC" Jun 12 18:21:51.839203 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.839137 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15123h53m59.445002489s" Jun 12 18:21:51.869982 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:51.869810 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee66534c8a708e52ad6bf5e42247133.slice/crio-d36da874f44ae6b83acd7157a1f34c9c937d735845b29ef28b8153f1714fd03a WatchSource:0}: Error finding container d36da874f44ae6b83acd7157a1f34c9c937d735845b29ef28b8153f1714fd03a: Status 404 returned error can't find the container with id d36da874f44ae6b83acd7157a1f34c9c937d735845b29ef28b8153f1714fd03a Jun 12 18:21:51.870294 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:51.870276 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430e56300c428255359659417cc0d456.slice/crio-587f6581befcb1694504f0a58ec71542f277898fb1b19db4d8ac4719b950e9f9 WatchSource:0}: Error finding container 587f6581befcb1694504f0a58ec71542f277898fb1b19db4d8ac4719b950e9f9: Status 404 returned error can't find the container with id 587f6581befcb1694504f0a58ec71542f277898fb1b19db4d8ac4719b950e9f9 Jun 12 18:21:51.874505 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.874489 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:21:51.914141 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.914053 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" event={"ID":"cee66534c8a708e52ad6bf5e42247133","Type":"ContainerStarted","Data":"d36da874f44ae6b83acd7157a1f34c9c937d735845b29ef28b8153f1714fd03a"} Jun 12 18:21:51.915087 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:51.915061 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" event={"ID":"430e56300c428255359659417cc0d456","Type":"ContainerStarted","Data":"587f6581befcb1694504f0a58ec71542f277898fb1b19db4d8ac4719b950e9f9"} Jun 12 18:21:51.936212 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:51.936185 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:52.036722 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.036686 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:52.137197 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.137166 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:52.171920 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.171849 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:52.237942 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.237908 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-194.ec2.internal\" not found" Jun 12 18:21:52.303194 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.303163 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:52.344692 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.344661 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" Jun 12 18:21:52.355929 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.355895 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:21:52.356908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.356887 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" Jun 12 18:21:52.365365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.365342 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:21:52.821755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.821669 2557 apiserver.go:52] "Watching apiserver" Jun 12 18:21:52.829499 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.829473 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:21:52.831015 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.830993 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck","openshift-image-registry/node-ca-9wc2q","openshift-multus/network-metrics-daemon-grvbq","openshift-network-diagnostics/network-check-target-s4kwt","openshift-network-operator/iptables-alerter-6hmjk","openshift-ovn-kubernetes/ovnkube-node-gjgsz","kube-system/konnectivity-agent-rvlgm","openshift-cluster-node-tuning-operator/tuned-xghhx","openshift-dns/node-resolver-fqc2q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal","openshift-multus/multus-additional-cni-plugins-c9npf","openshift-multus/multus-q4ds5","kube-system/global-pull-secret-syncer-dxr55","kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal"] Jun 12 18:21:52.832349 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.832332 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.833463 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.833441 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.833566 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.833523 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:21:52.834494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.834472 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:52.834599 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.834567 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:21:52.835132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.835113 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:21:52.835200 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.835136 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l9sf7\"" Jun 12 18:21:52.835359 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.835337 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:21:52.835638 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.835621 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:52.835704 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.835682 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:21:52.837263 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.837218 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.838631 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.838610 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.839718 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.839596 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.839718 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.839610 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gkq9d\"" Jun 12 18:21:52.839718 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.839618 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.839718 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.839668 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:21:52.840819 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.840772 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.841402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.841030 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbrlk\"" Jun 12 18:21:52.841402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.841270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:21:52.841402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.841287 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:21:52.841402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.841316 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.842127 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.842109 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.843413 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.843345 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.843503 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.843424 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:21:52.845072 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.843944 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.845072 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.844016 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:21:52.845208 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.845133 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:21:52.845208 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.845183 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.845496 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.845478 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h464j\"" Jun 12 18:21:52.845782 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.845763 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.845944 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.845926 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-67p28\"" Jun 12 18:21:52.846040 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.845922 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.846040 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.846027 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:21:52.847236 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.846263 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.847236 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.846768 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.847236 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.847000 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.847411 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.847348 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2gnw5\"" Jun 12 18:21:52.847411 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.847372 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.847502 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.847350 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:21:52.848645 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.848626 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.849167 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.849147 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.849673 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.849655 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nzgb5\"" Jun 12 18:21:52.849911 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.849893 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.850639 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.850623 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.851047 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.850913 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:21:52.851047 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.850941 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:21:52.851047 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.850975 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:21:52.851244 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.851177 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:21:52.851404 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.851385 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:21:52.851494 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.851470 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smmfz\"" Jun 12 18:21:52.852199 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.852180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:21:52.852298 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.852213 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rln9g\"" Jun 12 18:21:52.855761 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.855740 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:21:52.856484 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pbr4\" (UniqueName: \"kubernetes.io/projected/9cd5e1fc-6e2d-4494-879d-e524012db41c-kube-api-access-6pbr4\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.856594 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856491 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f69d0418-750d-4952-9161-9d2e947db538-serviceca\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.856594 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856508 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs854\" (UniqueName: \"kubernetes.io/projected/f000a819-adc5-42fc-951a-87404f6dc01e-kube-api-access-cs854\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.856594 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-lib-modules\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.856594 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-run-netns\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856608 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-cni-netd\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856649 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovnkube-config\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856678 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqlxv\" (UniqueName: \"kubernetes.io/projected/2bff06ab-9d88-49d8-8398-cbbf206b2524-kube-api-access-hqlxv\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f000a819-adc5-42fc-951a-87404f6dc01e-host-slash\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysctl-conf\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856779 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd5e1fc-6e2d-4494-879d-e524012db41c-tmp-dir\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.856800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-dbus\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-tmp\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856845 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-systemd-units\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856920 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-modprobe-d\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.856946 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-tuned\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857030 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cd5e1fc-6e2d-4494-879d-e524012db41c-hosts-file\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857068 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6l4\" (UniqueName: \"kubernetes.io/projected/f69d0418-750d-4952-9161-9d2e947db538-kube-api-access-dr6l4\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.857132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c69d2e26-8943-41ed-b91a-a0413fe2aa97-agent-certs\") pod \"konnectivity-agent-rvlgm\" (UID: \"c69d2e26-8943-41ed-b91a-a0413fe2aa97\") " pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-var-lib-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-registration-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857188 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysctl-d\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f000a819-adc5-42fc-951a-87404f6dc01e-iptables-alerter-script\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysconfig\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857298 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-kubernetes\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857335 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovnkube-script-lib\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857359 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-sys-fs\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-sys\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-etc-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-env-overrides\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857628 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c69d2e26-8943-41ed-b91a-a0413fe2aa97-konnectivity-ca\") pod \"konnectivity-agent-rvlgm\" (UID: \"c69d2e26-8943-41ed-b91a-a0413fe2aa97\") " pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857651 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:52.857682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857673 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-kubelet\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857708 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-slash\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-var-lib-kubelet\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857746 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-systemd\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857762 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-kubelet-config\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857784 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f796b\" (UniqueName: \"kubernetes.io/projected/095457ce-f584-46da-9ac8-c9d3b8d610a4-kube-api-access-f796b\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-systemd\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-run\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857875 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-host\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xvd\" (UniqueName: \"kubernetes.io/projected/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-kube-api-access-62xvd\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovn-node-metrics-cert\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857974 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-socket-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.857997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqb9q\" (UniqueName: \"kubernetes.io/projected/5af3cd83-9217-4f0a-b810-4e10897ba277-kube-api-access-rqb9q\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-ovn\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858041 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-node-log\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.858432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858063 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-log-socket\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.859198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858082 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-device-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.859198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.859198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:52.859198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-cni-bin\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.859198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.858180 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f69d0418-750d-4952-9161-9d2e947db538-host\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.875512 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.875487 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cwhns" Jun 12 18:21:52.883238 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.883212 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cwhns" Jun 12 18:21:52.946492 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.946466 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958804 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cd5e1fc-6e2d-4494-879d-e524012db41c-hosts-file\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6l4\" (UniqueName: \"kubernetes.io/projected/f69d0418-750d-4952-9161-9d2e947db538-kube-api-access-dr6l4\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c69d2e26-8943-41ed-b91a-a0413fe2aa97-agent-certs\") pod \"konnectivity-agent-rvlgm\" (UID: \"c69d2e26-8943-41ed-b91a-a0413fe2aa97\") " pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958894 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958914 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-cnibin\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-system-cni-dir\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-cnibin\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.958998 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-var-lib-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959026 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-registration-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.959118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959074 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysctl-d\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959149 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-registration-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959209 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-cni-multus\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959237 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysctl-d\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959278 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-multus-certs\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f000a819-adc5-42fc-951a-87404f6dc01e-iptables-alerter-script\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959414 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysconfig\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959417 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-var-lib-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-kubernetes\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959468 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9cd5e1fc-6e2d-4494-879d-e524012db41c-hosts-file\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-etc-kubernetes\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959514 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-kubernetes\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovnkube-script-lib\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959602 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysconfig\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959652 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-sys-fs\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.959741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-sys\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959806 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-sys-fs\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrstt\" (UniqueName: \"kubernetes.io/projected/b860d508-4282-4787-94c9-6b8334af983a-kube-api-access-mrstt\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959853 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-sys\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959917 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4r77\" (UniqueName: \"kubernetes.io/projected/a2d1bc1d-49a9-482c-aceb-42330589f461-kube-api-access-d4r77\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f000a819-adc5-42fc-951a-87404f6dc01e-iptables-alerter-script\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.960409 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.959971 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-etc-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.960689 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960669 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-etc-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.960822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960703 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.960822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-os-release\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.960822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960774 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-run-ovn-kubernetes\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.960822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-k8s-cni-cncf-io\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960828 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-os-release\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960859 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960866 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovnkube-script-lib\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960885 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-env-overrides\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c69d2e26-8943-41ed-b91a-a0413fe2aa97-konnectivity-ca\") pod \"konnectivity-agent-rvlgm\" (UID: \"c69d2e26-8943-41ed-b91a-a0413fe2aa97\") " pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960958 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960985 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-netns\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.961038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-kubelet\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-slash\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961084 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-var-lib-kubelet\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-hostroot\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b860d508-4282-4787-94c9-6b8334af983a-multus-daemon-config\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961136 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-systemd\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-kubelet-config\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961168 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f796b\" (UniqueName: \"kubernetes.io/projected/095457ce-f584-46da-9ac8-c9d3b8d610a4-kube-api-access-f796b\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-systemd\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961202 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-run\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961220 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-host\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961230 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-env-overrides\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961239 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xvd\" (UniqueName: \"kubernetes.io/projected/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-kube-api-access-62xvd\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961254 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961278 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovn-node-metrics-cert\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.960930 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961316 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-socket-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.961421 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961318 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-slash\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961331 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqb9q\" (UniqueName: \"kubernetes.io/projected/5af3cd83-9217-4f0a-b810-4e10897ba277-kube-api-access-rqb9q\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-openvswitch\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961400 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-systemd\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961414 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-socket-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961422 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c69d2e26-8943-41ed-b91a-a0413fe2aa97-konnectivity-ca\") pod \"konnectivity-agent-rvlgm\" (UID: \"c69d2e26-8943-41ed-b91a-a0413fe2aa97\") " pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961433 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-kubelet-config\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961470 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-systemd\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961564 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-conf-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961610 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-ovn\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-node-log\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961659 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-log-socket\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961683 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-device-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961706 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-run-ovn\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961766 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-device-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.962252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961773 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b860d508-4282-4787-94c9-6b8334af983a-cni-binary-copy\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961812 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-log-socket\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961836 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-run\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-etc-selinux\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961886 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-host\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961948 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-var-lib-kubelet\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961982 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-node-log\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.961994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-cni-bin\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962040 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-cni-bin\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962051 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-kubelet\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.962064 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962110 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f69d0418-750d-4952-9161-9d2e947db538-host\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.962123 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:53.462099447 +0000 UTC m=+3.031387884 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962148 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-socket-dir-parent\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962167 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f69d0418-750d-4952-9161-9d2e947db538-host\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962172 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-kubelet\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pbr4\" (UniqueName: \"kubernetes.io/projected/9cd5e1fc-6e2d-4494-879d-e524012db41c-kube-api-access-6pbr4\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.963037 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962243 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f69d0418-750d-4952-9161-9d2e947db538-serviceca\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs854\" (UniqueName: \"kubernetes.io/projected/f000a819-adc5-42fc-951a-87404f6dc01e-kube-api-access-cs854\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962423 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-lib-modules\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-run-netns\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962517 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-lib-modules\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962537 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-cni-netd\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962551 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovnkube-config\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqlxv\" (UniqueName: \"kubernetes.io/projected/2bff06ab-9d88-49d8-8398-cbbf206b2524-kube-api-access-hqlxv\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962746 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f69d0418-750d-4952-9161-9d2e947db538-serviceca\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.962999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovnkube-config\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963053 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-run-netns\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963083 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-cni-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963092 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-host-cni-netd\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963119 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-cni-bin\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963148 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f000a819-adc5-42fc-951a-87404f6dc01e-host-slash\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963173 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysctl-conf\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963181 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f000a819-adc5-42fc-951a-87404f6dc01e-host-slash\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:52.963908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963197 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd5e1fc-6e2d-4494-879d-e524012db41c-tmp-dir\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963227 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-dbus\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963247 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-tmp\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963322 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-dbus\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-sysctl-conf\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963381 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-systemd-units\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963407 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963432 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963456 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-modprobe-d\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963461 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cd5e1fc-6e2d-4494-879d-e524012db41c-tmp-dir\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963480 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-tuned\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963502 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2bff06ab-9d88-49d8-8398-cbbf206b2524-systemd-units\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963504 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-system-cni-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963546 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5af3cd83-9217-4f0a-b810-4e10897ba277-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963562 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-modprobe-d\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.963653 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:52.964726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963659 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:52.965522 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.963700 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:21:53.463683892 +0000 UTC m=+3.032972322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:52.965522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.963821 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bff06ab-9d88-49d8-8398-cbbf206b2524-ovn-node-metrics-cert\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.965522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.965221 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-tmp\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.965522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.965339 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c69d2e26-8943-41ed-b91a-a0413fe2aa97-agent-certs\") pod \"konnectivity-agent-rvlgm\" (UID: \"c69d2e26-8943-41ed-b91a-a0413fe2aa97\") " pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:52.965522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.965348 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-etc-tuned\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.971186 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.971160 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6l4\" (UniqueName: \"kubernetes.io/projected/f69d0418-750d-4952-9161-9d2e947db538-kube-api-access-dr6l4\") pod \"node-ca-9wc2q\" (UID: \"f69d0418-750d-4952-9161-9d2e947db538\") " pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:52.972786 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.972661 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:52.972786 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.972687 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:52.972786 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.972700 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:52.972786 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:52.972762 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:53.472746034 +0000 UTC m=+3.042034460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:52.974552 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.974512 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xvd\" (UniqueName: \"kubernetes.io/projected/8fdc85bf-b9c5-421e-8d3e-e25d5e86be55-kube-api-access-62xvd\") pod \"tuned-xghhx\" (UID: \"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55\") " pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:52.974781 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.974738 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pbr4\" (UniqueName: \"kubernetes.io/projected/9cd5e1fc-6e2d-4494-879d-e524012db41c-kube-api-access-6pbr4\") pod \"node-resolver-fqc2q\" (UID: \"9cd5e1fc-6e2d-4494-879d-e524012db41c\") " pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:52.975372 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.975177 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f796b\" (UniqueName: \"kubernetes.io/projected/095457ce-f584-46da-9ac8-c9d3b8d610a4-kube-api-access-f796b\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:52.975372 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.975332 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqb9q\" (UniqueName: \"kubernetes.io/projected/5af3cd83-9217-4f0a-b810-4e10897ba277-kube-api-access-rqb9q\") pod \"aws-ebs-csi-driver-node-zrgck\" (UID: \"5af3cd83-9217-4f0a-b810-4e10897ba277\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:52.975806 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.975785 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqlxv\" (UniqueName: \"kubernetes.io/projected/2bff06ab-9d88-49d8-8398-cbbf206b2524-kube-api-access-hqlxv\") pod \"ovnkube-node-gjgsz\" (UID: \"2bff06ab-9d88-49d8-8398-cbbf206b2524\") " pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:52.976470 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:52.976453 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs854\" (UniqueName: \"kubernetes.io/projected/f000a819-adc5-42fc-951a-87404f6dc01e-kube-api-access-cs854\") pod \"iptables-alerter-6hmjk\" (UID: \"f000a819-adc5-42fc-951a-87404f6dc01e\") " pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:53.064867 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064834 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-k8s-cni-cncf-io\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.064867 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-os-release\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064902 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-netns\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064943 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-k8s-cni-cncf-io\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064949 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-netns\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064975 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-hostroot\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.064996 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b860d508-4282-4787-94c9-6b8334af983a-multus-daemon-config\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-os-release\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065027 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-conf-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065052 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-hostroot\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-conf-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065096 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b860d508-4282-4787-94c9-6b8334af983a-cni-binary-copy\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065117 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-socket-dir-parent\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065141 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-kubelet\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-cni-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065195 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-cni-bin\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065228 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065232 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-socket-dir-parent\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065231 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-kubelet\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-system-cni-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065272 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-cni-bin\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065294 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065296 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-multus-cni-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-cnibin\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-system-cni-dir\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065375 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-cnibin\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-cnibin\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-cni-multus\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065352 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-system-cni-dir\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.065549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065435 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-multus-certs\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065446 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-var-lib-cni-multus\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-etc-kubernetes\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065494 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-cnibin\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrstt\" (UniqueName: \"kubernetes.io/projected/b860d508-4282-4787-94c9-6b8334af983a-kube-api-access-mrstt\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065537 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-host-run-multus-certs\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065546 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-system-cni-dir\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065639 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b860d508-4282-4787-94c9-6b8334af983a-multus-daemon-config\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-etc-kubernetes\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065660 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b860d508-4282-4787-94c9-6b8334af983a-cni-binary-copy\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065598 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4r77\" (UniqueName: \"kubernetes.io/projected/a2d1bc1d-49a9-482c-aceb-42330589f461-kube-api-access-d4r77\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065705 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-os-release\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065760 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a2d1bc1d-49a9-482c-aceb-42330589f461-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065791 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b860d508-4282-4787-94c9-6b8334af983a-os-release\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065837 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.066340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.065880 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.067140 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.066145 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a2d1bc1d-49a9-482c-aceb-42330589f461-cni-binary-copy\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.080799 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.080714 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrstt\" (UniqueName: \"kubernetes.io/projected/b860d508-4282-4787-94c9-6b8334af983a-kube-api-access-mrstt\") pod \"multus-q4ds5\" (UID: \"b860d508-4282-4787-94c9-6b8334af983a\") " pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.080799 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.080717 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4r77\" (UniqueName: \"kubernetes.io/projected/a2d1bc1d-49a9-482c-aceb-42330589f461-kube-api-access-d4r77\") pod \"multus-additional-cni-plugins-c9npf\" (UID: \"a2d1bc1d-49a9-482c-aceb-42330589f461\") " pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.146514 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.146476 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:21:53.153461 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.153433 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6hmjk" Jun 12 18:21:53.162267 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.162248 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:21:53.166938 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.166918 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fqc2q" Jun 12 18:21:53.173543 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.173521 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" Jun 12 18:21:53.180302 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.180273 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wc2q" Jun 12 18:21:53.186886 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.186865 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xghhx" Jun 12 18:21:53.193612 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.193589 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c9npf" Jun 12 18:21:53.199179 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.199159 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q4ds5" Jun 12 18:21:53.364970 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.364909 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:53.468476 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.468443 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:53.468643 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.468490 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:53.468643 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.468597 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:53.468643 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.468620 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:53.468793 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.468664 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:54.468644194 +0000 UTC m=+4.037932623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:53.468793 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.468686 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:21:54.468674511 +0000 UTC m=+4.037962921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:53.568907 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.568868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:53.569069 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.569034 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:53.569069 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.569061 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:53.569157 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.569076 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:53.569157 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:53.569137 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:54.569120366 +0000 UTC m=+4.138408794 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:53.645899 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.645862 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bff06ab_9d88_49d8_8398_cbbf206b2524.slice/crio-033f8cfee3e7aa35b781185ff96953c66927d80a8d40f3d869a628917841d50d WatchSource:0}: Error finding container 033f8cfee3e7aa35b781185ff96953c66927d80a8d40f3d869a628917841d50d: Status 404 returned error can't find the container with id 033f8cfee3e7aa35b781185ff96953c66927d80a8d40f3d869a628917841d50d Jun 12 18:21:53.647024 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.647003 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb860d508_4282_4787_94c9_6b8334af983a.slice/crio-1a7571a360e92ac4f5c730c5016b2f30e8034dbf55de1fa3c6bfb3516f71ae9b WatchSource:0}: Error finding container 1a7571a360e92ac4f5c730c5016b2f30e8034dbf55de1fa3c6bfb3516f71ae9b: Status 404 returned error can't find the container with id 1a7571a360e92ac4f5c730c5016b2f30e8034dbf55de1fa3c6bfb3516f71ae9b Jun 12 18:21:53.648538 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.648517 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69d0418_750d_4952_9161_9d2e947db538.slice/crio-d3f2c1883d4f69a2360e0160a54cf9a835cd54e9e6e4f31821b87d4fffe39fc9 WatchSource:0}: Error finding container d3f2c1883d4f69a2360e0160a54cf9a835cd54e9e6e4f31821b87d4fffe39fc9: Status 404 returned error can't find the container with id d3f2c1883d4f69a2360e0160a54cf9a835cd54e9e6e4f31821b87d4fffe39fc9 Jun 12 18:21:53.669838 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.669803 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d1bc1d_49a9_482c_aceb_42330589f461.slice/crio-17d57ed81b12c16847d657fe78aa945001552172e954962bd24e7e38e7b2b5a7 WatchSource:0}: Error finding container 17d57ed81b12c16847d657fe78aa945001552172e954962bd24e7e38e7b2b5a7: Status 404 returned error can't find the container with id 17d57ed81b12c16847d657fe78aa945001552172e954962bd24e7e38e7b2b5a7 Jun 12 18:21:53.670716 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.670692 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf000a819_adc5_42fc_951a_87404f6dc01e.slice/crio-4fe60583ff1434d2a34280b502ece1ada4b568778ee3917de1f3bd19ff19c372 WatchSource:0}: Error finding container 4fe60583ff1434d2a34280b502ece1ada4b568778ee3917de1f3bd19ff19c372: Status 404 returned error can't find the container with id 4fe60583ff1434d2a34280b502ece1ada4b568778ee3917de1f3bd19ff19c372 Jun 12 18:21:53.671462 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.671355 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69d2e26_8943_41ed_b91a_a0413fe2aa97.slice/crio-bc4d3dba483e8e51e1ae78749953cf22d7af0187551efd1125eccee201647d82 WatchSource:0}: Error finding container bc4d3dba483e8e51e1ae78749953cf22d7af0187551efd1125eccee201647d82: Status 404 returned error can't find the container with id bc4d3dba483e8e51e1ae78749953cf22d7af0187551efd1125eccee201647d82 Jun 12 18:21:53.672407 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.672370 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af3cd83_9217_4f0a_b810_4e10897ba277.slice/crio-589926be0c0e231ae3165b51cafe57b8478e8037056616b0c3e431966a9b49b7 WatchSource:0}: Error finding container 589926be0c0e231ae3165b51cafe57b8478e8037056616b0c3e431966a9b49b7: Status 404 returned error can't find the container with id 589926be0c0e231ae3165b51cafe57b8478e8037056616b0c3e431966a9b49b7 Jun 12 18:21:53.674290 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.674270 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fdc85bf_b9c5_421e_8d3e_e25d5e86be55.slice/crio-39f1f429f984f985573c398f6efea63afa8bdeb07f31fec56de18afbf2f4f27a WatchSource:0}: Error finding container 39f1f429f984f985573c398f6efea63afa8bdeb07f31fec56de18afbf2f4f27a: Status 404 returned error can't find the container with id 39f1f429f984f985573c398f6efea63afa8bdeb07f31fec56de18afbf2f4f27a Jun 12 18:21:53.676039 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:21:53.676021 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd5e1fc_6e2d_4494_879d_e524012db41c.slice/crio-81165ecb36fbb0ef44ea8663ae8f7998e48d42079af8f80b5cf0a8c1e0487c16 WatchSource:0}: Error finding container 81165ecb36fbb0ef44ea8663ae8f7998e48d42079af8f80b5cf0a8c1e0487c16: Status 404 returned error can't find the container with id 81165ecb36fbb0ef44ea8663ae8f7998e48d42079af8f80b5cf0a8c1e0487c16 Jun 12 18:21:53.886048 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.885967 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:16:52 +0000 UTC" deadline="2027-11-23 00:14:09.930700108 +0000 UTC" Jun 12 18:21:53.886048 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.886009 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12677h52m16.044693309s" Jun 12 18:21:53.920391 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.920356 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" event={"ID":"cee66534c8a708e52ad6bf5e42247133","Type":"ContainerStarted","Data":"c12a51f18cdd51b228fe4042a43f99c4e1a2da858c1bf9fb3dacaec42e017991"} Jun 12 18:21:53.921928 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.921902 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" event={"ID":"430e56300c428255359659417cc0d456","Type":"ContainerStarted","Data":"f5fa3d4ec8d8b15b28ad1752cd7d929ec6f1738dac55bc18f75ddffccb112e6d"} Jun 12 18:21:53.922923 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.922900 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" event={"ID":"5af3cd83-9217-4f0a-b810-4e10897ba277","Type":"ContainerStarted","Data":"589926be0c0e231ae3165b51cafe57b8478e8037056616b0c3e431966a9b49b7"} Jun 12 18:21:53.923904 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.923885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rvlgm" event={"ID":"c69d2e26-8943-41ed-b91a-a0413fe2aa97","Type":"ContainerStarted","Data":"bc4d3dba483e8e51e1ae78749953cf22d7af0187551efd1125eccee201647d82"} Jun 12 18:21:53.924907 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.924885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6hmjk" event={"ID":"f000a819-adc5-42fc-951a-87404f6dc01e","Type":"ContainerStarted","Data":"4fe60583ff1434d2a34280b502ece1ada4b568778ee3917de1f3bd19ff19c372"} Jun 12 18:21:53.925970 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.925952 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerStarted","Data":"17d57ed81b12c16847d657fe78aa945001552172e954962bd24e7e38e7b2b5a7"} Jun 12 18:21:53.927012 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.926992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wc2q" event={"ID":"f69d0418-750d-4952-9161-9d2e947db538","Type":"ContainerStarted","Data":"d3f2c1883d4f69a2360e0160a54cf9a835cd54e9e6e4f31821b87d4fffe39fc9"} Jun 12 18:21:53.928063 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.928043 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"033f8cfee3e7aa35b781185ff96953c66927d80a8d40f3d869a628917841d50d"} Jun 12 18:21:53.929093 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.929068 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fqc2q" event={"ID":"9cd5e1fc-6e2d-4494-879d-e524012db41c","Type":"ContainerStarted","Data":"81165ecb36fbb0ef44ea8663ae8f7998e48d42079af8f80b5cf0a8c1e0487c16"} Jun 12 18:21:53.930160 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.930142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xghhx" event={"ID":"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55","Type":"ContainerStarted","Data":"39f1f429f984f985573c398f6efea63afa8bdeb07f31fec56de18afbf2f4f27a"} Jun 12 18:21:53.931121 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.931102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4ds5" event={"ID":"b860d508-4282-4787-94c9-6b8334af983a","Type":"ContainerStarted","Data":"1a7571a360e92ac4f5c730c5016b2f30e8034dbf55de1fa3c6bfb3516f71ae9b"} Jun 12 18:21:53.934688 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:53.934652 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-194.ec2.internal" podStartSLOduration=1.934640615 podStartE2EDuration="1.934640615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:21:53.934128228 +0000 UTC m=+3.503416672" watchObservedRunningTime="2026-06-12 18:21:53.934640615 +0000 UTC m=+3.503929124" Jun 12 18:21:54.476022 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.475977 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:54.476210 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.476043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:54.476210 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.476192 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:54.476323 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.476254 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:21:56.476236727 +0000 UTC m=+6.045525142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:54.476685 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.476665 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:54.476780 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.476721 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:56.476703074 +0000 UTC m=+6.045991487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:54.577096 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.577057 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:54.577259 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.577223 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:54.577259 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.577244 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:54.577259 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.577257 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:54.577428 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.577312 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:56.577295816 +0000 UTC m=+6.146584231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:54.886799 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.886635 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:16:52 +0000 UTC" deadline="2027-12-22 18:38:15.745869351 +0000 UTC" Jun 12 18:21:54.886799 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.886677 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13392h16m20.859197953s" Jun 12 18:21:54.914979 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.914163 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:54.914979 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.914286 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:21:54.914979 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.914695 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:54.914979 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.914788 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:21:54.914979 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.914852 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:54.914979 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:54.914931 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:21:54.942603 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.942243 2557 generic.go:356] "Generic (PLEG): container finished" podID="430e56300c428255359659417cc0d456" containerID="f5fa3d4ec8d8b15b28ad1752cd7d929ec6f1738dac55bc18f75ddffccb112e6d" exitCode=0 Jun 12 18:21:54.943702 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:54.943430 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" event={"ID":"430e56300c428255359659417cc0d456","Type":"ContainerDied","Data":"f5fa3d4ec8d8b15b28ad1752cd7d929ec6f1738dac55bc18f75ddffccb112e6d"} Jun 12 18:21:55.958251 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:55.958166 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" event={"ID":"430e56300c428255359659417cc0d456","Type":"ContainerStarted","Data":"3b8177da8eab11c15af9c7a97c6553370afda876ae97f8934ed2378295503baa"} Jun 12 18:21:56.499767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:56.499726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:56.499958 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:56.499834 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:56.500038 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.499960 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:56.500087 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.500050 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:22:00.500031047 +0000 UTC m=+10.069319471 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:56.500513 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.500442 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:56.500513 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.500492 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:00.500477323 +0000 UTC m=+10.069765739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:56.600827 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:56.600786 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:56.601013 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.600949 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:56.601013 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.600969 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:56.601013 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.600983 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:56.601182 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.601060 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:00.601041711 +0000 UTC m=+10.170330135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:56.916559 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:56.915655 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:56.916559 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.915794 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:21:56.916559 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:56.916198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:56.916559 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.916297 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:21:56.916559 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:56.916358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:56.916559 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:56.916507 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:21:58.915348 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:58.915317 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:21:58.915812 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:58.915439 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:21:58.915812 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:58.915485 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:21:58.915812 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:21:58.915493 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:21:58.915812 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:58.915628 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:21:58.915812 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:21:58.915715 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:00.534389 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:00.534354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:00.534389 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:00.534402 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:00.534932 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.534497 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:00.534932 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.534543 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:22:08.534529664 +0000 UTC m=+18.103818072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:00.534932 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.534802 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:00.534932 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.534860 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:08.534848003 +0000 UTC m=+18.104136411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:00.635630 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:00.635591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:00.635813 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.635733 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:22:00.635813 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.635762 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:22:00.635813 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.635777 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:00.635958 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.635842 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:08.635823323 +0000 UTC m=+18.205111738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:00.914806 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:00.914498 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:00.914959 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.914884 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:00.915288 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:00.915264 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:00.915392 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.915368 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:00.915522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:00.915422 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:00.915522 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:00.915496 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:02.911759 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:02.911723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:02.912229 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:02.911786 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:02.912229 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:02.911803 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:02.912229 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:02.911919 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:02.912229 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:02.912011 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:02.912229 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:02.912104 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:04.911870 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:04.911786 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:04.911870 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:04.911826 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:04.912365 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:04.911937 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:04.912365 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:04.911989 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:04.912365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:04.912030 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:04.912365 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:04.912129 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:06.912088 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:06.912052 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:06.912558 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:06.912052 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:06.912558 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:06.912053 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:06.912558 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:06.912198 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:06.912558 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:06.912318 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:06.912558 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:06.912425 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:08.595353 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:08.595318 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:08.595818 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:08.595397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:08.595818 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.595476 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:08.595818 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.595494 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:08.595818 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.595540 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:22:24.595521214 +0000 UTC m=+34.164809631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:08.595818 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.595558 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:24.595548957 +0000 UTC m=+34.164837367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:08.695756 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:08.695720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:08.695925 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.695877 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:22:08.695925 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.695897 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:22:08.695925 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.695907 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:08.696064 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.695954 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:24.695942466 +0000 UTC m=+34.265230874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:08.911557 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:08.911470 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:08.911734 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:08.911478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:08.911734 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.911610 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:08.911734 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.911713 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:08.911900 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:08.911477 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:08.911900 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:08.911817 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:10.912937 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:10.912903 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:10.913396 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:10.912991 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:10.913396 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:10.913003 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:10.913396 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:10.913116 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:10.913396 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:10.913157 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:10.913396 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:10.913283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:12.911926 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.911675 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:12.911926 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.911670 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:12.912751 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:12.911958 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:12.912751 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.911723 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:12.912751 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:12.911996 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:12.912751 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:12.912097 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:12.993552 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.993508 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wc2q" event={"ID":"f69d0418-750d-4952-9161-9d2e947db538","Type":"ContainerStarted","Data":"132ce4d940f60f7cd2ceee85cacc61372bb42008189c36c7a48c8cbfc7956d94"} Jun 12 18:22:12.995205 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.995170 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fqc2q" event={"ID":"9cd5e1fc-6e2d-4494-879d-e524012db41c","Type":"ContainerStarted","Data":"2b27edc605a3a7b90ca393dd3fed23329d431cac3256ae2c738eb6e038aece8e"} Jun 12 18:22:12.996834 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.996809 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xghhx" event={"ID":"8fdc85bf-b9c5-421e-8d3e-e25d5e86be55","Type":"ContainerStarted","Data":"24244c48dde683d37741d59378617aed91c8520ec0924d9f49486d9a703ed616"} Jun 12 18:22:12.998435 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.998408 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q4ds5" event={"ID":"b860d508-4282-4787-94c9-6b8334af983a","Type":"ContainerStarted","Data":"4bbc0835b72e806b727602c89f081be96d7dec7742df86145bceddb135bd135d"} Jun 12 18:22:12.999971 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:12.999949 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" event={"ID":"5af3cd83-9217-4f0a-b810-4e10897ba277","Type":"ContainerStarted","Data":"4767c0b867e03b57fb6e15f3e20a9e37c8e73d7a7e4301d7a494ecea9b8e15ee"} Jun 12 18:22:13.001439 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.001416 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rvlgm" event={"ID":"c69d2e26-8943-41ed-b91a-a0413fe2aa97","Type":"ContainerStarted","Data":"d174360356635af8917f4b400a86e7bb3b6a995cf533b65e9739076b8810e8e7"} Jun 12 18:22:13.002858 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.002838 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerStarted","Data":"af2f9168710e5957a38d319bbd2d62f6b432c8da3f1f57996c7b3cfbf9e4d3c7"} Jun 12 18:22:13.009517 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.009475 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-194.ec2.internal" podStartSLOduration=21.009463834 podStartE2EDuration="21.009463834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:21:55.975565225 +0000 UTC m=+5.544853657" watchObservedRunningTime="2026-06-12 18:22:13.009463834 +0000 UTC m=+22.578752314" Jun 12 18:22:13.009876 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.009847 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9wc2q" podStartSLOduration=3.426018578 podStartE2EDuration="22.009839378s" totalImagesPullingTime="18.5838208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:13.009390704 +0000 UTC m=+22.578679135" watchObservedRunningTime="2026-06-12 18:22:13.009839378 +0000 UTC m=+22.579127808" Jun 12 18:22:13.030334 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.030288 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xghhx" podStartSLOduration=3.125384278 podStartE2EDuration="22.03027818s" totalImagesPullingTime="18.904893902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:13.029763515 +0000 UTC m=+22.599051968" watchObservedRunningTime="2026-06-12 18:22:13.03027818 +0000 UTC m=+22.599566610" Jun 12 18:22:13.046991 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.046942 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q4ds5" podStartSLOduration=3.095774742 podStartE2EDuration="22.046929663s" totalImagesPullingTime="18.951154921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:13.046447921 +0000 UTC m=+22.615736352" watchObservedRunningTime="2026-06-12 18:22:13.046929663 +0000 UTC m=+22.616218093" Jun 12 18:22:13.067131 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.067085 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rvlgm" podStartSLOduration=7.754566533 podStartE2EDuration="22.067069226s" totalImagesPullingTime="14.312502693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:13.06699492 +0000 UTC m=+22.636283363" watchObservedRunningTime="2026-06-12 18:22:13.067069226 +0000 UTC m=+22.636357657" Jun 12 18:22:13.113081 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:13.113036 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fqc2q" podStartSLOduration=3.21081161 podStartE2EDuration="22.113020579s" totalImagesPullingTime="18.902208969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:13.11285833 +0000 UTC m=+22.682146761" watchObservedRunningTime="2026-06-12 18:22:13.113020579 +0000 UTC m=+22.682309010" Jun 12 18:22:14.006179 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.005933 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6hmjk" event={"ID":"f000a819-adc5-42fc-951a-87404f6dc01e","Type":"ContainerStarted","Data":"088246cf467d5299f2eb7bf32bbfc12f10a8744eb1ca144e6434202a50b76962"} Jun 12 18:22:14.007429 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.007402 2557 generic.go:356] "Generic (PLEG): container finished" podID="a2d1bc1d-49a9-482c-aceb-42330589f461" containerID="af2f9168710e5957a38d319bbd2d62f6b432c8da3f1f57996c7b3cfbf9e4d3c7" exitCode=0 Jun 12 18:22:14.007533 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.007487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerDied","Data":"af2f9168710e5957a38d319bbd2d62f6b432c8da3f1f57996c7b3cfbf9e4d3c7"} Jun 12 18:22:14.010246 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010228 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:22:14.010567 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010546 2557 generic.go:356] "Generic (PLEG): container finished" podID="2bff06ab-9d88-49d8-8398-cbbf206b2524" containerID="ed7f4cfddf5ace34fc41ef12128f07276808aaa1dfdcf23542533ae8d2136be1" exitCode=1 Jun 12 18:22:14.010681 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010640 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"13d1eade9802b37e539d0aa06ad247ddb7efc366d10398ce8fe47d810268bf78"} Jun 12 18:22:14.010747 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010731 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"44376569cc7a9cf49e86eec399d8f69858cbee68310ac6fd2c4d5b057321b728"} Jun 12 18:22:14.010805 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010786 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"27c0ee05d69c6e209848f23444a92fff7796ba2c89566e498e4fd3ef5bcbea13"} Jun 12 18:22:14.010896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010835 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"b156457308219c2f90cb792304d561a37018293e01e58c2ad7b97e5105b7a9bd"} Jun 12 18:22:14.010896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerDied","Data":"ed7f4cfddf5ace34fc41ef12128f07276808aaa1dfdcf23542533ae8d2136be1"} Jun 12 18:22:14.010985 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.010934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"b88d1d5bfd1c169ce728673d75d2487e2b84fd12a301201c2ed70b935e4590d9"} Jun 12 18:22:14.023122 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.023094 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:22:14.042218 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.042165 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6hmjk" podStartSLOduration=4.134280932 podStartE2EDuration="23.042149361s" totalImagesPullingTime="18.907868429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:14.020836256 +0000 UTC m=+23.590124706" watchObservedRunningTime="2026-06-12 18:22:14.042149361 +0000 UTC m=+23.611437796" Jun 12 18:22:14.287105 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.287016 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:22:14.287540 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.287526 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:22:14.912375 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.912341 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:14.912689 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:14.912464 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:14.912900 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.912878 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:14.913007 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:14.912985 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:14.913082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.913055 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:14.913164 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:14.913137 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:14.915674 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.915567 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:22:14.023114826Z","UUID":"015ef5ad-1426-4aa5-b547-62128ed63a42","Handler":null,"Name":"","Endpoint":""} Jun 12 18:22:14.917217 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.917197 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:22:14.917316 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:14.917233 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:22:15.015330 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:15.015290 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" event={"ID":"5af3cd83-9217-4f0a-b810-4e10897ba277","Type":"ContainerStarted","Data":"6f9e74a2a2770d1d00e64b7299bddb2bd26243478d6a9924d907389adafc5a15"} Jun 12 18:22:15.015909 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:15.015491 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:22:15.016025 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:15.016003 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rvlgm" Jun 12 18:22:16.020341 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.020306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" event={"ID":"5af3cd83-9217-4f0a-b810-4e10897ba277","Type":"ContainerStarted","Data":"37007f3b7f41463f5b23bf972da4a19196120ce0c8f8c06cd2eb4d91f911e967"} Jun 12 18:22:16.023949 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.023925 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:22:16.024297 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.024265 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"b69d9aec34cbd70ddaea5d8f3fea3edfc8baf0c7c0c122865e6c185eb660c8e1"} Jun 12 18:22:16.043786 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.043739 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zrgck" podStartSLOduration=8.491122824 podStartE2EDuration="25.043723774s" totalImagesPullingTime="16.55260095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:16.043529141 +0000 UTC m=+25.612817590" watchObservedRunningTime="2026-06-12 18:22:16.043723774 +0000 UTC m=+25.613012205" Jun 12 18:22:16.911831 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.911796 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:16.912006 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.911796 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:16.912006 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:16.911796 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:16.912006 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:16.911929 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:16.912157 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:16.912029 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:16.912157 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:16.912112 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:18.912628 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:18.912304 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:18.913149 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:18.912344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:18.913149 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:18.912690 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:18.913149 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:18.912348 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:18.913149 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:18.912742 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:18.913149 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:18.912792 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:19.033187 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.033152 2557 generic.go:356] "Generic (PLEG): container finished" podID="a2d1bc1d-49a9-482c-aceb-42330589f461" containerID="9be0c39f023a99d2166b838e669c4e1a07257b8ecb9cd6fbed1031ffb5c3effd" exitCode=0 Jun 12 18:22:19.033372 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.033243 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerDied","Data":"9be0c39f023a99d2166b838e669c4e1a07257b8ecb9cd6fbed1031ffb5c3effd"} Jun 12 18:22:19.036829 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.036813 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:22:19.037171 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.037151 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"f307d53b3bb62b5ddca263991acc3adbe5575b9410e0f70d7d55b8bd49cae2fa"} Jun 12 18:22:19.037463 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.037451 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:22:19.037669 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.037652 2557 scope.go:117] "RemoveContainer" containerID="ed7f4cfddf5ace34fc41ef12128f07276808aaa1dfdcf23542533ae8d2136be1" Jun 12 18:22:19.054108 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:19.054071 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:22:20.042322 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.042079 2557 generic.go:356] "Generic (PLEG): container finished" podID="a2d1bc1d-49a9-482c-aceb-42330589f461" containerID="cb31c1c48218e8bd1f15b43bfb59e6fa7d1bb493a7459c1e6c448c6c3d50c6cc" exitCode=0 Jun 12 18:22:20.042770 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.042139 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerDied","Data":"cb31c1c48218e8bd1f15b43bfb59e6fa7d1bb493a7459c1e6c448c6c3d50c6cc"} Jun 12 18:22:20.046412 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.046392 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:22:20.046796 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.046775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" event={"ID":"2bff06ab-9d88-49d8-8398-cbbf206b2524","Type":"ContainerStarted","Data":"405d5ec986ec3d1727bd69f7383812600f845125756e1efe5f99ccd47c29b2ed"} Jun 12 18:22:20.047166 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.047149 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:22:20.047255 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.047235 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:22:20.063535 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.063482 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:22:20.100373 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.100318 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" podStartSLOduration=9.747664451 podStartE2EDuration="29.100303621s" totalImagesPullingTime="19.35263917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:20.091009677 +0000 UTC m=+29.660298127" watchObservedRunningTime="2026-06-12 18:22:20.100303621 +0000 UTC m=+29.669592108" Jun 12 18:22:20.186098 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.186064 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxr55"] Jun 12 18:22:20.186290 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.186226 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:20.186365 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:20.186335 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:20.186746 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.186726 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4kwt"] Jun 12 18:22:20.186816 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.186805 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:20.186897 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:20.186881 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:20.188248 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.188224 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grvbq"] Jun 12 18:22:20.188366 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:20.188316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:20.188406 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:20.188388 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:21.912179 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:21.912142 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:21.912819 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:21.912143 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:21.912819 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:21.912249 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:21.912819 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:21.912356 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:21.912819 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:21.912145 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:21.912819 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:21.912460 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:22.053849 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:22.053812 2557 generic.go:356] "Generic (PLEG): container finished" podID="a2d1bc1d-49a9-482c-aceb-42330589f461" containerID="ee7670d8ce8632ebc2886091a37f14ef36e1e7ebf5128a671ccb4f36dfe23d67" exitCode=0 Jun 12 18:22:22.053980 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:22.053846 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerDied","Data":"ee7670d8ce8632ebc2886091a37f14ef36e1e7ebf5128a671ccb4f36dfe23d67"} Jun 12 18:22:23.911999 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:23.911901 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:23.911999 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:23.911920 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:23.911999 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:23.911901 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:23.912732 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:23.912038 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:23.912732 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:23.912111 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:23.912732 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:23.912198 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:24.615219 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:24.615033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:24.615406 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:24.615236 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:24.615406 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.615183 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:24.615406 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.615332 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:24.615406 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.615353 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:56.615332393 +0000 UTC m=+66.184620803 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:24.615406 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.615374 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret podName:01a981c4-8749-4dfb-9096-fe2ff3bc8b7f nodeName:}" failed. No retries permitted until 2026-06-12 18:22:56.615363417 +0000 UTC m=+66.184651826 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret") pod "global-pull-secret-syncer-dxr55" (UID: "01a981c4-8749-4dfb-9096-fe2ff3bc8b7f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:24.715765 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:24.715726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:24.715933 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.715912 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:22:24.715984 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.715940 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:22:24.715984 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.715953 2557 projected.go:196] Error preparing data for projected volume kube-api-access-zg9kq for pod openshift-network-diagnostics/network-check-target-s4kwt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:24.716136 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:24.716017 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq podName:c8ca820e-8de4-4233-b84a-08768a6f7e74 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:56.716003147 +0000 UTC m=+66.285291556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zg9kq" (UniqueName: "kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq") pod "network-check-target-s4kwt" (UID: "c8ca820e-8de4-4233-b84a-08768a6f7e74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:25.911397 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:25.911365 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:25.911844 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:25.911462 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:25.911844 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:25.911470 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s4kwt" podUID="c8ca820e-8de4-4233-b84a-08768a6f7e74" Jun 12 18:22:25.911844 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:25.911540 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dxr55" podUID="01a981c4-8749-4dfb-9096-fe2ff3bc8b7f" Jun 12 18:22:25.911844 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:25.911568 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:25.911844 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:25.911710 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:22:26.704853 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.704825 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-194.ec2.internal" event="NodeReady" Jun 12 18:22:26.705024 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.704989 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:22:26.745861 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.745773 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4b6df"] Jun 12 18:22:26.762726 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.762699 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dsgj9"] Jun 12 18:22:26.762875 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.762830 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:26.765425 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.765404 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5r6\"" Jun 12 18:22:26.765542 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.765405 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:22:26.765542 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.765411 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:22:26.776568 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.776549 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4b6df"] Jun 12 18:22:26.776673 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.776603 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dsgj9"] Jun 12 18:22:26.776673 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.776671 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:26.779328 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.779310 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:22:26.779328 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.779323 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dffzh\"" Jun 12 18:22:26.779490 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.779332 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:22:26.779490 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.779384 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:22:26.932811 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.932777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5v78\" (UniqueName: \"kubernetes.io/projected/c3d71330-055d-42db-ab4d-ba8feed28ad0-kube-api-access-k5v78\") pod \"ingress-canary-dsgj9\" (UID: \"c3d71330-055d-42db-ab4d-ba8feed28ad0\") " pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:26.933226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.932825 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/da42943f-19b8-4c9a-a2a6-4e1070faef1b-config-volume\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:26.933226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.932844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3d71330-055d-42db-ab4d-ba8feed28ad0-cert\") pod \"ingress-canary-dsgj9\" (UID: \"c3d71330-055d-42db-ab4d-ba8feed28ad0\") " pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:26.933226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.932933 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:26.933226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.932969 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hsl7\" (UniqueName: \"kubernetes.io/projected/da42943f-19b8-4c9a-a2a6-4e1070faef1b-kube-api-access-6hsl7\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:26.933226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:26.933019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da42943f-19b8-4c9a-a2a6-4e1070faef1b-tmp-dir\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.034368 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034272 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5v78\" (UniqueName: \"kubernetes.io/projected/c3d71330-055d-42db-ab4d-ba8feed28ad0-kube-api-access-k5v78\") pod \"ingress-canary-dsgj9\" (UID: \"c3d71330-055d-42db-ab4d-ba8feed28ad0\") " pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:27.034368 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034321 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/da42943f-19b8-4c9a-a2a6-4e1070faef1b-config-volume\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.034368 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034339 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3d71330-055d-42db-ab4d-ba8feed28ad0-cert\") pod \"ingress-canary-dsgj9\" (UID: \"c3d71330-055d-42db-ab4d-ba8feed28ad0\") " pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:27.034368 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034363 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.034755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034386 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hsl7\" (UniqueName: \"kubernetes.io/projected/da42943f-19b8-4c9a-a2a6-4e1070faef1b-kube-api-access-6hsl7\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.034755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da42943f-19b8-4c9a-a2a6-4e1070faef1b-tmp-dir\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.034755 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:27.034475 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:27.034755 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:27.034553 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:22:27.534534372 +0000 UTC m=+37.103822804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:22:27.034960 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.034798 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da42943f-19b8-4c9a-a2a6-4e1070faef1b-tmp-dir\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.035076 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.035054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/da42943f-19b8-4c9a-a2a6-4e1070faef1b-config-volume\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.038541 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.038521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3d71330-055d-42db-ab4d-ba8feed28ad0-cert\") pod \"ingress-canary-dsgj9\" (UID: \"c3d71330-055d-42db-ab4d-ba8feed28ad0\") " pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:27.043703 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.043683 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hsl7\" (UniqueName: \"kubernetes.io/projected/da42943f-19b8-4c9a-a2a6-4e1070faef1b-kube-api-access-6hsl7\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.043812 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.043792 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5v78\" (UniqueName: \"kubernetes.io/projected/c3d71330-055d-42db-ab4d-ba8feed28ad0-kube-api-access-k5v78\") pod \"ingress-canary-dsgj9\" (UID: \"c3d71330-055d-42db-ab4d-ba8feed28ad0\") " pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:27.067974 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.067939 2557 generic.go:356] "Generic (PLEG): container finished" podID="a2d1bc1d-49a9-482c-aceb-42330589f461" containerID="63bc91fae470cbc2299e94329c2ec954361a1f77f16aadba824c94b8087cd5b2" exitCode=0 Jun 12 18:22:27.068092 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.068003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerDied","Data":"63bc91fae470cbc2299e94329c2ec954361a1f77f16aadba824c94b8087cd5b2"} Jun 12 18:22:27.085051 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.085027 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dsgj9" Jun 12 18:22:27.242299 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.242101 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dsgj9"] Jun 12 18:22:27.247294 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:22:27.247267 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d71330_055d_42db_ab4d_ba8feed28ad0.slice/crio-2c56ae52a931eca5d9132a65e02e6ed96baa166756ee1836b6446db0f4c7c276 WatchSource:0}: Error finding container 2c56ae52a931eca5d9132a65e02e6ed96baa166756ee1836b6446db0f4c7c276: Status 404 returned error can't find the container with id 2c56ae52a931eca5d9132a65e02e6ed96baa166756ee1836b6446db0f4c7c276 Jun 12 18:22:27.538123 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.538084 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:27.538295 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:27.538258 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:27.538343 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:27.538322 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:22:28.538306023 +0000 UTC m=+38.107594437 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:22:27.912082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.911998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:27.912082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.912044 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:27.912321 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.912109 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:27.915193 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.915166 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:22:27.915377 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.915209 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kk7mw\"" Jun 12 18:22:27.915377 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.915166 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:22:27.916302 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.916280 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:22:27.916473 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.916456 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:22:27.916538 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:27.916497 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkx6l\"" Jun 12 18:22:28.074951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:28.074911 2557 generic.go:356] "Generic (PLEG): container finished" podID="a2d1bc1d-49a9-482c-aceb-42330589f461" containerID="b50c88bc411ea3ff10e1d24a8e2cb48dad2221b4571318a0ff6bdd5c1cd9c422" exitCode=0 Jun 12 18:22:28.075381 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:28.074955 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerDied","Data":"b50c88bc411ea3ff10e1d24a8e2cb48dad2221b4571318a0ff6bdd5c1cd9c422"} Jun 12 18:22:28.076419 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:28.076398 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dsgj9" event={"ID":"c3d71330-055d-42db-ab4d-ba8feed28ad0","Type":"ContainerStarted","Data":"2c56ae52a931eca5d9132a65e02e6ed96baa166756ee1836b6446db0f4c7c276"} Jun 12 18:22:28.547167 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:28.547123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:28.547357 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:28.547261 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:28.547357 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:28.547333 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:22:30.547317407 +0000 UTC m=+40.116605830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:22:29.080365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:29.080273 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dsgj9" event={"ID":"c3d71330-055d-42db-ab4d-ba8feed28ad0","Type":"ContainerStarted","Data":"dd6d9fb0dc59fd6cb02480a7ed72cfaee0b3f18d1c2bee1a9372e1ce7c370417"} Jun 12 18:22:29.083708 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:29.083686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c9npf" event={"ID":"a2d1bc1d-49a9-482c-aceb-42330589f461","Type":"ContainerStarted","Data":"7a70e1954b5fbf46570d71a7c298792f00882a16919b65c22169ba0f0304c01b"} Jun 12 18:22:29.097318 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:29.097271 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dsgj9" podStartSLOduration=1.599139718 podStartE2EDuration="3.097254735s" totalImagesPullingTime="1.498115017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:29.096599392 +0000 UTC m=+38.665887834" watchObservedRunningTime="2026-06-12 18:22:29.097254735 +0000 UTC m=+38.666543167" Jun 12 18:22:29.118830 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:29.118778 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c9npf" podStartSLOduration=13.293478073 podStartE2EDuration="38.118763872s" totalImagesPullingTime="24.825285799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:29.118244115 +0000 UTC m=+38.687532546" watchObservedRunningTime="2026-06-12 18:22:29.118763872 +0000 UTC m=+38.688052304" Jun 12 18:22:30.562384 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:30.562344 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:30.562774 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:30.562469 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:30.562774 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:30.562522 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:22:34.562507237 +0000 UTC m=+44.131795646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:22:34.591772 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:34.591715 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:34.592140 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:34.591864 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:34.592140 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:34.591930 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:22:42.591915115 +0000 UTC m=+52.161203524 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:22:39.385824 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.385792 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh"] Jun 12 18:22:39.402385 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.402351 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh"] Jun 12 18:22:39.402523 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.402459 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.405027 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.405006 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 12 18:22:39.405149 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.405046 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:22:39.405149 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.405046 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 12 18:22:39.405347 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.405333 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:22:39.405401 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.405389 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 12 18:22:39.406021 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.406008 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 12 18:22:39.406120 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.406106 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:22:39.526470 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.526429 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-hub\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.526470 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.526473 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.526696 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.526552 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4xtr\" (UniqueName: \"kubernetes.io/projected/09855273-143b-4643-9141-97c6ef5bd35b-kube-api-access-r4xtr\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.526696 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.526655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-ca\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.526696 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.526681 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.526792 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.526718 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/09855273-143b-4643-9141-97c6ef5bd35b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.627440 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.627405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4xtr\" (UniqueName: \"kubernetes.io/projected/09855273-143b-4643-9141-97c6ef5bd35b-kube-api-access-r4xtr\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.627656 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.627455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-ca\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.627656 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.627475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.627656 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.627496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/09855273-143b-4643-9141-97c6ef5bd35b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.627656 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.627540 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-hub\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.627656 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.627591 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.628282 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.628238 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/09855273-143b-4643-9141-97c6ef5bd35b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.631006 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.630982 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-ca\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.631212 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.631187 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.631280 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.631199 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-hub\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.631334 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.631320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09855273-143b-4643-9141-97c6ef5bd35b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.635318 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.635298 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4xtr\" (UniqueName: \"kubernetes.io/projected/09855273-143b-4643-9141-97c6ef5bd35b-kube-api-access-r4xtr\") pod \"cluster-proxy-proxy-agent-5dc67c677d-q5tmh\" (UID: \"09855273-143b-4643-9141-97c6ef5bd35b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.725570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.725532 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:22:39.865084 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:39.865049 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh"] Jun 12 18:22:39.868497 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:22:39.868452 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09855273_143b_4643_9141_97c6ef5bd35b.slice/crio-03cf4e61eeb0892dcc3b51739cc318802e494cb5616d032318a93908a7996667 WatchSource:0}: Error finding container 03cf4e61eeb0892dcc3b51739cc318802e494cb5616d032318a93908a7996667: Status 404 returned error can't find the container with id 03cf4e61eeb0892dcc3b51739cc318802e494cb5616d032318a93908a7996667 Jun 12 18:22:40.107637 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:40.107545 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" event={"ID":"09855273-143b-4643-9141-97c6ef5bd35b","Type":"ContainerStarted","Data":"03cf4e61eeb0892dcc3b51739cc318802e494cb5616d032318a93908a7996667"} Jun 12 18:22:42.654428 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:42.654387 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:42.655110 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:42.654549 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:42.655110 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:42.654651 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:22:58.654631624 +0000 UTC m=+68.223920034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:22:45.123309 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:45.123270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" event={"ID":"09855273-143b-4643-9141-97c6ef5bd35b","Type":"ContainerStarted","Data":"54774fff8c3da0b9303744eb858c9ca07466cd69bfe5f07e0c48ae7cc0aca974"} Jun 12 18:22:45.123747 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:45.123319 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" event={"ID":"09855273-143b-4643-9141-97c6ef5bd35b","Type":"ContainerStarted","Data":"7d91ac90b40788f6d988fb282f92b64f9d0005205ebe7e272ff2f94b4fa31837"} Jun 12 18:22:45.123747 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:45.123337 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" event={"ID":"09855273-143b-4643-9141-97c6ef5bd35b","Type":"ContainerStarted","Data":"c9b05fc033827ec2310621b17296b43f7ba930236d811dfab510269054831cfa"} Jun 12 18:22:45.142498 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:45.142450 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" podStartSLOduration=1.64804132 podStartE2EDuration="6.142434178s" totalImagesPullingTime="4.494392858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:45.142134715 +0000 UTC m=+54.711423165" watchObservedRunningTime="2026-06-12 18:22:45.142434178 +0000 UTC m=+54.711722609" Jun 12 18:22:52.064724 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:52.064695 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gjgsz" Jun 12 18:22:56.647428 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.647389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:22:56.647849 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.647440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:56.650972 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.650953 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:22:56.651055 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.651036 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:22:56.658012 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:56.657994 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:22:56.658065 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:56.658048 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:24:00.658032535 +0000 UTC m=+130.227320944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : secret "metrics-daemon-secret" not found Jun 12 18:22:56.660245 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.660215 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01a981c4-8749-4dfb-9096-fe2ff3bc8b7f-original-pull-secret\") pod \"global-pull-secret-syncer-dxr55\" (UID: \"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f\") " pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:56.724431 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.724388 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dxr55" Jun 12 18:22:56.747974 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.747947 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:56.750889 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.750867 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:22:56.761395 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.761369 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:22:56.772507 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.772480 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9kq\" (UniqueName: \"kubernetes.io/projected/c8ca820e-8de4-4233-b84a-08768a6f7e74-kube-api-access-zg9kq\") pod \"network-check-target-s4kwt\" (UID: \"c8ca820e-8de4-4233-b84a-08768a6f7e74\") " pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:56.844487 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:56.844455 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dxr55"] Jun 12 18:22:56.847400 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:22:56.847375 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a981c4_8749_4dfb_9096_fe2ff3bc8b7f.slice/crio-249c126224054429d9e023283ccd5ed14c9a511997e5421c9ba32fe66bdf714b WatchSource:0}: Error finding container 249c126224054429d9e023283ccd5ed14c9a511997e5421c9ba32fe66bdf714b: Status 404 returned error can't find the container with id 249c126224054429d9e023283ccd5ed14c9a511997e5421c9ba32fe66bdf714b Jun 12 18:22:57.034179 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:57.034146 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkx6l\"" Jun 12 18:22:57.042247 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:57.042225 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:22:57.154198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:57.154167 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxr55" event={"ID":"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f","Type":"ContainerStarted","Data":"249c126224054429d9e023283ccd5ed14c9a511997e5421c9ba32fe66bdf714b"} Jun 12 18:22:57.159875 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:57.159850 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s4kwt"] Jun 12 18:22:57.162419 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:22:57.162398 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ca820e_8de4_4233_b84a_08768a6f7e74.slice/crio-56b23c1b470a09377cbeb62fcbcc80e823790faa568811aa7151e5bc8735d3a7 WatchSource:0}: Error finding container 56b23c1b470a09377cbeb62fcbcc80e823790faa568811aa7151e5bc8735d3a7: Status 404 returned error can't find the container with id 56b23c1b470a09377cbeb62fcbcc80e823790faa568811aa7151e5bc8735d3a7 Jun 12 18:22:58.158933 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:58.158890 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4kwt" event={"ID":"c8ca820e-8de4-4233-b84a-08768a6f7e74","Type":"ContainerStarted","Data":"56b23c1b470a09377cbeb62fcbcc80e823790faa568811aa7151e5bc8735d3a7"} Jun 12 18:22:58.664391 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:22:58.664349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:22:58.664611 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:58.664531 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:58.664683 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:22:58.664634 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:23:30.66461482 +0000 UTC m=+100.233903232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:23:02.171600 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:02.171495 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s4kwt" event={"ID":"c8ca820e-8de4-4233-b84a-08768a6f7e74","Type":"ContainerStarted","Data":"20f86d560f905b2d38ef5a125669258afc97e0657b887ab870a29941306bf4a8"} Jun 12 18:23:02.171600 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:02.171569 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:23:02.172967 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:02.172945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dxr55" event={"ID":"01a981c4-8749-4dfb-9096-fe2ff3bc8b7f","Type":"ContainerStarted","Data":"1cb534ad2e4fcb4cebad61e6f09a738cd4e78eda30e5a89377c8e2e8ba3d3043"} Jun 12 18:23:02.187625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:02.187559 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s4kwt" podStartSLOduration=66.581979384 podStartE2EDuration="1m11.187547233s" totalImagesPullingTime="4.605567849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:23:02.186044651 +0000 UTC m=+71.755333101" watchObservedRunningTime="2026-06-12 18:23:02.187547233 +0000 UTC m=+71.756835668" Jun 12 18:23:02.199330 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:02.199287 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dxr55" podStartSLOduration=66.267774046 podStartE2EDuration="1m11.199275264s" totalImagesPullingTime="4.931501218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:23:02.198626679 +0000 UTC m=+71.767915130" watchObservedRunningTime="2026-06-12 18:23:02.199275264 +0000 UTC m=+71.768563695" Jun 12 18:23:30.690466 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:30.690426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:23:30.690902 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:23:30.690600 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:23:30.690902 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:23:30.690676 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:24:34.690658675 +0000 UTC m=+164.259947084 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:23:33.182392 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:23:33.182358 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s4kwt" Jun 12 18:24:00.696648 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:00.696599 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:24:00.697130 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:00.696752 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:24:00.697130 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:00.696818 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs podName:095457ce-f584-46da-9ac8-c9d3b8d610a4 nodeName:}" failed. No retries permitted until 2026-06-12 18:26:02.696799692 +0000 UTC m=+252.266088116 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs") pod "network-metrics-daemon-grvbq" (UID: "095457ce-f584-46da-9ac8-c9d3b8d610a4") : secret "metrics-daemon-secret" not found Jun 12 18:24:29.771668 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:29.771626 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4b6df" podUID="da42943f-19b8-4c9a-a2a6-4e1070faef1b" Jun 12 18:24:30.426872 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:30.426842 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4b6df" Jun 12 18:24:30.937875 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:30.937840 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-grvbq" podUID="095457ce-f584-46da-9ac8-c9d3b8d610a4" Jun 12 18:24:34.749852 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:34.749810 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:24:34.750243 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:34.749920 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:24:34.750243 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:34.749995 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls podName:da42943f-19b8-4c9a-a2a6-4e1070faef1b nodeName:}" failed. No retries permitted until 2026-06-12 18:26:36.749981627 +0000 UTC m=+286.319270036 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls") pod "dns-default-4b6df" (UID: "da42943f-19b8-4c9a-a2a6-4e1070faef1b") : secret "dns-default-metrics-tls" not found Jun 12 18:24:45.911532 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:45.911447 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:24:57.832120 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.832086 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx"] Jun 12 18:24:57.833994 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.833974 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:57.836340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.836321 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-jqwf6\"" Jun 12 18:24:57.837450 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.837424 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 12 18:24:57.838692 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.838658 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:24:57.838822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.838692 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:24:57.838822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.838700 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 12 18:24:57.847477 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.847455 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx"] Jun 12 18:24:57.902837 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.902806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msv2f\" (UniqueName: \"kubernetes.io/projected/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-kube-api-access-msv2f\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:57.902963 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.902850 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:57.902963 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:57.902872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.003252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:58.003216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msv2f\" (UniqueName: \"kubernetes.io/projected/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-kube-api-access-msv2f\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.003252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:58.003260 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.003460 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:58.003283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.003460 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:58.003428 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 18:24:58.003694 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:58.003497 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls podName:335eacfa-8e80-40b8-9b7e-0dfc82013f9f nodeName:}" failed. No retries permitted until 2026-06-12 18:24:58.503477449 +0000 UTC m=+188.072765873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d9hpx" (UID: "335eacfa-8e80-40b8-9b7e-0dfc82013f9f") : secret "cluster-monitoring-operator-tls" not found Jun 12 18:24:58.004011 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:58.003991 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.011418 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:58.011390 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msv2f\" (UniqueName: \"kubernetes.io/projected/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-kube-api-access-msv2f\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.508046 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:58.508012 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:58.508200 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:58.508124 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 18:24:58.508200 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:58.508185 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls podName:335eacfa-8e80-40b8-9b7e-0dfc82013f9f nodeName:}" failed. No retries permitted until 2026-06-12 18:24:59.508169787 +0000 UTC m=+189.077458199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d9hpx" (UID: "335eacfa-8e80-40b8-9b7e-0dfc82013f9f") : secret "cluster-monitoring-operator-tls" not found Jun 12 18:24:59.515760 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:24:59.515726 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:24:59.516147 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:59.515873 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 18:24:59.516147 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:24:59.515933 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls podName:335eacfa-8e80-40b8-9b7e-0dfc82013f9f nodeName:}" failed. No retries permitted until 2026-06-12 18:25:01.515917768 +0000 UTC m=+191.085206177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d9hpx" (UID: "335eacfa-8e80-40b8-9b7e-0dfc82013f9f") : secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:01.529208 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:01.529174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:25:01.529619 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:01.529325 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:01.529619 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:01.529398 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls podName:335eacfa-8e80-40b8-9b7e-0dfc82013f9f nodeName:}" failed. No retries permitted until 2026-06-12 18:25:05.529382995 +0000 UTC m=+195.098671404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d9hpx" (UID: "335eacfa-8e80-40b8-9b7e-0dfc82013f9f") : secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:02.897565 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.897530 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hd6dl"] Jun 12 18:25:02.899503 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.899485 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:02.902755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.902736 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:25:02.902855 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.902794 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xgl2j\"" Jun 12 18:25:02.903867 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.903846 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:25:02.903921 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.903872 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:25:02.904475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.904455 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:25:02.915480 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:02.915456 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hd6dl"] Jun 12 18:25:03.040833 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.040790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.041114 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.040918 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqgk8\" (UniqueName: \"kubernetes.io/projected/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-api-access-kqgk8\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.041114 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.040949 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.041114 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.040978 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd74eb39-5b69-4ae2-bf77-f505eeba3367-data-volume\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.041114 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.041040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd74eb39-5b69-4ae2-bf77-f505eeba3367-crio-socket\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142250 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142216 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd74eb39-5b69-4ae2-bf77-f505eeba3367-crio-socket\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142250 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142257 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142307 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqgk8\" (UniqueName: \"kubernetes.io/projected/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-api-access-kqgk8\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142325 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd74eb39-5b69-4ae2-bf77-f505eeba3367-data-volume\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142475 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142354 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cd74eb39-5b69-4ae2-bf77-f505eeba3367-crio-socket\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.142475 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.142440 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:03.142750 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.142509 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.142750 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.142514 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:03.642498398 +0000 UTC m=+193.211786807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : configmap "kube-rbac-proxy" not found Jun 12 18:25:03.142750 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.142566 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:03.642554545 +0000 UTC m=+193.211842955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.142878 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.142761 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd74eb39-5b69-4ae2-bf77-f505eeba3367-data-volume\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.152316 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.152259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqgk8\" (UniqueName: \"kubernetes.io/projected/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-api-access-kqgk8\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.645908 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.645870 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.646095 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:03.645950 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:03.646095 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.646034 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:03.646095 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.646089 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:04.646075529 +0000 UTC m=+194.215363938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : configmap "kube-rbac-proxy" not found Jun 12 18:25:03.646202 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.646034 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.646202 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:03.646161 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:04.646149042 +0000 UTC m=+194.215437468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:04.656259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:04.656199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:04.656706 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:04.656289 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:04.656706 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:04.656318 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:04.656706 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:04.656378 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:06.656364081 +0000 UTC m=+196.225652490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : configmap "kube-rbac-proxy" not found Jun 12 18:25:04.656706 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:04.656407 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:04.656706 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:04.656457 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:06.656444599 +0000 UTC m=+196.225733008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:05.486204 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:05.486177 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fqc2q_9cd5e1fc-6e2d-4494-879d-e524012db41c/dns-node-resolver/0.log" Jun 12 18:25:05.563072 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:05.563038 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:25:05.563247 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:05.563200 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:05.563292 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:05.563263 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls podName:335eacfa-8e80-40b8-9b7e-0dfc82013f9f nodeName:}" failed. No retries permitted until 2026-06-12 18:25:13.563247531 +0000 UTC m=+203.132535941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d9hpx" (UID: "335eacfa-8e80-40b8-9b7e-0dfc82013f9f") : secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:06.487773 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:06.487744 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wc2q_f69d0418-750d-4952-9161-9d2e947db538/node-ca/0.log" Jun 12 18:25:06.672367 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:06.672326 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:06.672559 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:06.672423 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:06.672559 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:06.672484 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:06.672559 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:06.672533 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:06.672559 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:06.672548 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:10.672533321 +0000 UTC m=+200.241821730 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:06.672753 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:06.672609 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:10.672569208 +0000 UTC m=+200.241857616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : configmap "kube-rbac-proxy" not found Jun 12 18:25:07.488840 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:07.488810 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dsgj9_c3d71330-055d-42db-ab4d-ba8feed28ad0/serve-healthcheck-canary/0.log" Jun 12 18:25:10.704104 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:10.704052 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:10.704607 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:10.704158 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:10.704607 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:10.704217 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:10.704607 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:10.704260 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:10.704607 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:10.704284 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:18.704269481 +0000 UTC m=+208.273557890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:10.704607 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:10.704311 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm podName:cd74eb39-5b69-4ae2-bf77-f505eeba3367 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:18.704297406 +0000 UTC m=+208.273585816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hd6dl" (UID: "cd74eb39-5b69-4ae2-bf77-f505eeba3367") : configmap "kube-rbac-proxy" not found Jun 12 18:25:13.625331 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:13.625288 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:25:13.625772 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:13.625406 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:13.625772 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:13.625477 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls podName:335eacfa-8e80-40b8-9b7e-0dfc82013f9f nodeName:}" failed. No retries permitted until 2026-06-12 18:25:29.625463298 +0000 UTC m=+219.194751708 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-d9hpx" (UID: "335eacfa-8e80-40b8-9b7e-0dfc82013f9f") : secret "cluster-monitoring-operator-tls" not found Jun 12 18:25:18.765806 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:18.765767 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:18.766289 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:18.765834 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:18.766289 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:18.766276 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cd74eb39-5b69-4ae2-bf77-f505eeba3367-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:18.768128 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:18.768105 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cd74eb39-5b69-4ae2-bf77-f505eeba3367-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hd6dl\" (UID: \"cd74eb39-5b69-4ae2-bf77-f505eeba3367\") " pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:18.808380 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:18.808342 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hd6dl" Jun 12 18:25:18.928279 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:18.928243 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hd6dl"] Jun 12 18:25:18.931284 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:18.931259 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd74eb39_5b69_4ae2_bf77_f505eeba3367.slice/crio-7cf1be9a5f810f8ab40b15a50d59686285a1554eeb9a89e42df6b12a162ddad7 WatchSource:0}: Error finding container 7cf1be9a5f810f8ab40b15a50d59686285a1554eeb9a89e42df6b12a162ddad7: Status 404 returned error can't find the container with id 7cf1be9a5f810f8ab40b15a50d59686285a1554eeb9a89e42df6b12a162ddad7 Jun 12 18:25:19.567128 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:19.567045 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6dl" event={"ID":"cd74eb39-5b69-4ae2-bf77-f505eeba3367","Type":"ContainerStarted","Data":"7cf1be9a5f810f8ab40b15a50d59686285a1554eeb9a89e42df6b12a162ddad7"} Jun 12 18:25:19.727672 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:19.727618 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" podUID="09855273-143b-4643-9141-97c6ef5bd35b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:25:22.577904 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:22.577868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6dl" event={"ID":"cd74eb39-5b69-4ae2-bf77-f505eeba3367","Type":"ContainerStarted","Data":"ff679f3fe0aa311cde711904d93ee7606eb1a7c66b59f8429560fa309d731575"} Jun 12 18:25:23.584135 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:23.584096 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6dl" event={"ID":"cd74eb39-5b69-4ae2-bf77-f505eeba3367","Type":"ContainerStarted","Data":"e87364ad8fbe73ca00f52f46ca30e6cffeedd2f4c10ca52827a07f7ac0568382"} Jun 12 18:25:24.590612 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:24.590504 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hd6dl" event={"ID":"cd74eb39-5b69-4ae2-bf77-f505eeba3367","Type":"ContainerStarted","Data":"146fd1ed28306ffb4ba846d75e18d9230e7b008168a6147a795e845edc10f160"} Jun 12 18:25:24.608775 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:24.608719 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hd6dl" podStartSLOduration=17.325439218 podStartE2EDuration="22.608704066s" totalImagesPullingTime="5.283264848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:25:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:24.606779259 +0000 UTC m=+214.176067691" watchObservedRunningTime="2026-06-12 18:25:24.608704066 +0000 UTC m=+214.177992498" Jun 12 18:25:26.010312 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.010276 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-n5d5t"] Jun 12 18:25:26.013215 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.013198 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:26.015685 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.015658 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 18:25:26.015824 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.015715 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5lfbg\"" Jun 12 18:25:26.015824 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.015716 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 18:25:26.025249 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.025216 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-n5d5t"] Jun 12 18:25:26.053594 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.053546 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-ffd8d99c7-wjq75"] Jun 12 18:25:26.056523 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.056504 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.059094 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.059068 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 18:25:26.059094 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.059087 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 18:25:26.059252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.059094 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 18:25:26.059252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.059076 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drmhm\"" Jun 12 18:25:26.064560 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.064541 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 18:25:26.068716 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.068695 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ffd8d99c7-wjq75"] Jun 12 18:25:26.128090 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.128054 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmtp\" (UniqueName: \"kubernetes.io/projected/2d1bb578-0083-45e0-b6ef-1a129f8c2660-kube-api-access-cqmtp\") pod \"downloads-694c955b9-n5d5t\" (UID: \"2d1bb578-0083-45e0-b6ef-1a129f8c2660\") " pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:26.229276 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11946b1b-1832-4299-ad35-a877ae2e6efe-registry-certificates\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229448 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229295 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmtp\" (UniqueName: \"kubernetes.io/projected/2d1bb578-0083-45e0-b6ef-1a129f8c2660-kube-api-access-cqmtp\") pod \"downloads-694c955b9-n5d5t\" (UID: \"2d1bb578-0083-45e0-b6ef-1a129f8c2660\") " pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:26.229448 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229415 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g52v7\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-kube-api-access-g52v7\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229516 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229454 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11946b1b-1832-4299-ad35-a877ae2e6efe-image-registry-private-configuration\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229516 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229485 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11946b1b-1832-4299-ad35-a877ae2e6efe-trusted-ca\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229607 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-bound-sa-token\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229607 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229550 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11946b1b-1832-4299-ad35-a877ae2e6efe-ca-trust-extracted\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11946b1b-1832-4299-ad35-a877ae2e6efe-installation-pull-secrets\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.229680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.229662 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-registry-tls\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.240049 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.240020 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmtp\" (UniqueName: \"kubernetes.io/projected/2d1bb578-0083-45e0-b6ef-1a129f8c2660-kube-api-access-cqmtp\") pod \"downloads-694c955b9-n5d5t\" (UID: \"2d1bb578-0083-45e0-b6ef-1a129f8c2660\") " pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:26.325593 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.325491 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:26.330490 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g52v7\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-kube-api-access-g52v7\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330551 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11946b1b-1832-4299-ad35-a877ae2e6efe-image-registry-private-configuration\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330551 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11946b1b-1832-4299-ad35-a877ae2e6efe-trusted-ca\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330666 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330566 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-bound-sa-token\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330666 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11946b1b-1832-4299-ad35-a877ae2e6efe-ca-trust-extracted\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330779 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330665 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11946b1b-1832-4299-ad35-a877ae2e6efe-installation-pull-secrets\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330779 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330699 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-registry-tls\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.330779 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.330723 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11946b1b-1832-4299-ad35-a877ae2e6efe-registry-certificates\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.331155 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.331116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/11946b1b-1832-4299-ad35-a877ae2e6efe-ca-trust-extracted\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.331673 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.331632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/11946b1b-1832-4299-ad35-a877ae2e6efe-registry-certificates\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.331769 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.331689 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/11946b1b-1832-4299-ad35-a877ae2e6efe-trusted-ca\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.333526 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.333497 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/11946b1b-1832-4299-ad35-a877ae2e6efe-image-registry-private-configuration\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.333526 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.333519 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/11946b1b-1832-4299-ad35-a877ae2e6efe-installation-pull-secrets\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.333704 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.333597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-registry-tls\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.338255 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.338232 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g52v7\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-kube-api-access-g52v7\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.342010 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.341981 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/11946b1b-1832-4299-ad35-a877ae2e6efe-bound-sa-token\") pod \"image-registry-ffd8d99c7-wjq75\" (UID: \"11946b1b-1832-4299-ad35-a877ae2e6efe\") " pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.366676 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.366644 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.456734 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.456702 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-n5d5t"] Jun 12 18:25:26.459663 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:26.459637 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d1bb578_0083_45e0_b6ef_1a129f8c2660.slice/crio-fd4888ce8e20a70eaed8432406f74df40b3d6a43b57434baf92c2c562a1a16e4 WatchSource:0}: Error finding container fd4888ce8e20a70eaed8432406f74df40b3d6a43b57434baf92c2c562a1a16e4: Status 404 returned error can't find the container with id fd4888ce8e20a70eaed8432406f74df40b3d6a43b57434baf92c2c562a1a16e4 Jun 12 18:25:26.501229 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.501195 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ffd8d99c7-wjq75"] Jun 12 18:25:26.503956 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:26.503934 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11946b1b_1832_4299_ad35_a877ae2e6efe.slice/crio-4eb9c481d2fd5b203842279156781dd7ad4ec8b9a89c7752bd1473ea30753fe4 WatchSource:0}: Error finding container 4eb9c481d2fd5b203842279156781dd7ad4ec8b9a89c7752bd1473ea30753fe4: Status 404 returned error can't find the container with id 4eb9c481d2fd5b203842279156781dd7ad4ec8b9a89c7752bd1473ea30753fe4 Jun 12 18:25:26.598449 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.598352 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-n5d5t" event={"ID":"2d1bb578-0083-45e0-b6ef-1a129f8c2660","Type":"ContainerStarted","Data":"fd4888ce8e20a70eaed8432406f74df40b3d6a43b57434baf92c2c562a1a16e4"} Jun 12 18:25:26.599876 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.599849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" event={"ID":"11946b1b-1832-4299-ad35-a877ae2e6efe","Type":"ContainerStarted","Data":"3c82d21302ec7f64027ceac3bc9f0c477bd5993cd2d3229bf52ba6f6f0192fcd"} Jun 12 18:25:26.599984 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.599889 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" event={"ID":"11946b1b-1832-4299-ad35-a877ae2e6efe","Type":"ContainerStarted","Data":"4eb9c481d2fd5b203842279156781dd7ad4ec8b9a89c7752bd1473ea30753fe4"} Jun 12 18:25:26.600058 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.599989 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:25:26.618356 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:26.618305 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podStartSLOduration=0.618290355 podStartE2EDuration="618.290355ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:26.617428036 +0000 UTC m=+216.186716469" watchObservedRunningTime="2026-06-12 18:25:26.618290355 +0000 UTC m=+216.187578808" Jun 12 18:25:29.658138 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:29.658092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:25:29.660468 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:29.660449 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/335eacfa-8e80-40b8-9b7e-0dfc82013f9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-d9hpx\" (UID: \"335eacfa-8e80-40b8-9b7e-0dfc82013f9f\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:25:29.727249 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:29.727213 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" podUID="09855273-143b-4643-9141-97c6ef5bd35b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:25:29.942411 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:29.942307 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" Jun 12 18:25:30.075020 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:30.074986 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx"] Jun 12 18:25:30.078756 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:30.078728 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335eacfa_8e80_40b8_9b7e_0dfc82013f9f.slice/crio-e4446eab317909f519084ff27a59e3c3b82e87ee2df27f335102f1bf63aa0278 WatchSource:0}: Error finding container e4446eab317909f519084ff27a59e3c3b82e87ee2df27f335102f1bf63aa0278: Status 404 returned error can't find the container with id e4446eab317909f519084ff27a59e3c3b82e87ee2df27f335102f1bf63aa0278 Jun 12 18:25:30.614544 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:30.614513 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" event={"ID":"335eacfa-8e80-40b8-9b7e-0dfc82013f9f","Type":"ContainerStarted","Data":"e4446eab317909f519084ff27a59e3c3b82e87ee2df27f335102f1bf63aa0278"} Jun 12 18:25:32.623691 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:32.623651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" event={"ID":"335eacfa-8e80-40b8-9b7e-0dfc82013f9f","Type":"ContainerStarted","Data":"a40cba7dc172a6e95c6cfe68511bb2880a86a9643305b4895683275cb807514b"} Jun 12 18:25:32.640680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:32.640625 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-d9hpx" podStartSLOduration=33.303912267 podStartE2EDuration="35.640601157s" totalImagesPullingTime="2.33668889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:32.63965625 +0000 UTC m=+222.208944681" watchObservedRunningTime="2026-06-12 18:25:32.640601157 +0000 UTC m=+222.209889589" Jun 12 18:25:39.727349 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:39.727302 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" podUID="09855273-143b-4643-9141-97c6ef5bd35b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 12 18:25:39.727807 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:39.727382 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" Jun 12 18:25:39.727958 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:39.727928 2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"54774fff8c3da0b9303744eb858c9ca07466cd69bfe5f07e0c48ae7cc0aca974"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 12 18:25:39.727995 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:39.727981 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" podUID="09855273-143b-4643-9141-97c6ef5bd35b" containerName="service-proxy" containerID="cri-o://54774fff8c3da0b9303744eb858c9ca07466cd69bfe5f07e0c48ae7cc0aca974" gracePeriod=30 Jun 12 18:25:40.651472 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:40.651433 2557 generic.go:356] "Generic (PLEG): container finished" podID="09855273-143b-4643-9141-97c6ef5bd35b" containerID="54774fff8c3da0b9303744eb858c9ca07466cd69bfe5f07e0c48ae7cc0aca974" exitCode=2 Jun 12 18:25:40.651472 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:40.651452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" event={"ID":"09855273-143b-4643-9141-97c6ef5bd35b","Type":"ContainerDied","Data":"54774fff8c3da0b9303744eb858c9ca07466cd69bfe5f07e0c48ae7cc0aca974"} Jun 12 18:25:40.651731 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:40.651510 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5dc67c677d-q5tmh" event={"ID":"09855273-143b-4643-9141-97c6ef5bd35b","Type":"ContainerStarted","Data":"00a27b20a3bbf7bc1ad6c9bf55e6da2fc5309da30f8dca6ff9da81b895abd3c0"} Jun 12 18:25:42.285388 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.285356 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-chhzv"] Jun 12 18:25:42.330311 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.330264 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-chhzv"] Jun 12 18:25:42.330502 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.330324 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mxx4r"] Jun 12 18:25:42.330736 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.330706 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.336790 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.336733 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 18:25:42.336790 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.336764 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 18:25:42.337530 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.337400 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:25:42.341104 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.341081 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 18:25:42.341315 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.341270 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9nqp8\"" Jun 12 18:25:42.342930 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.342909 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.346619 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.346597 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:25:42.346619 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.346611 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:25:42.346776 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.346643 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:25:42.350643 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.350460 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9jkqd\"" Jun 12 18:25:42.352731 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.352707 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f0b31b12-6297-4db5-912d-8a0c63f51b05-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.352834 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.352743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.352834 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.352770 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.352834 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.352819 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.352980 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.352897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0b31b12-6297-4db5-912d-8a0c63f51b05-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.352980 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.352945 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-754g8\" (UniqueName: \"kubernetes.io/projected/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-api-access-754g8\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453345 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453310 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-textfile\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453345 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-sys\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453630 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453393 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-wtmp\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453630 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453424 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f0b31b12-6297-4db5-912d-8a0c63f51b05-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453630 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453630 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453474 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453630 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453509 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e912ec-bbbc-4273-b9f8-5ab785960ecb-metrics-client-ca\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453630 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:42.453599 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453660 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:42.453682 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-tls podName:f0b31b12-6297-4db5-912d-8a0c63f51b05 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:42.953663892 +0000 UTC m=+232.522952317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-chhzv" (UID: "f0b31b12-6297-4db5-912d-8a0c63f51b05") : secret "kube-state-metrics-tls" not found Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453712 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-root\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453745 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mksn\" (UniqueName: \"kubernetes.io/projected/76e912ec-bbbc-4273-b9f8-5ab785960ecb-kube-api-access-6mksn\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453803 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0b31b12-6297-4db5-912d-8a0c63f51b05-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453872 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f0b31b12-6297-4db5-912d-8a0c63f51b05-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.453936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-754g8\" (UniqueName: \"kubernetes.io/projected/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-api-access-754g8\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.454333 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.454333 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.453990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-tls\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.454333 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.454214 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.454675 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.454637 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0b31b12-6297-4db5-912d-8a0c63f51b05-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.456787 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.456768 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.462988 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.462964 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-754g8\" (UniqueName: \"kubernetes.io/projected/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-api-access-754g8\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.554671 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.554671 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-tls\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.554671 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-textfile\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.554671 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554673 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-sys\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554710 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-wtmp\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e912ec-bbbc-4273-b9f8-5ab785960ecb-metrics-client-ca\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-root\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:42.554791 2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.554838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mksn\" (UniqueName: \"kubernetes.io/projected/76e912ec-bbbc-4273-b9f8-5ab785960ecb-kube-api-access-6mksn\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555038 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:42.554866 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-tls podName:76e912ec-bbbc-4273-b9f8-5ab785960ecb nodeName:}" failed. No retries permitted until 2026-06-12 18:25:43.054847321 +0000 UTC m=+232.624135754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-tls") pod "node-exporter-mxx4r" (UID: "76e912ec-bbbc-4273-b9f8-5ab785960ecb") : secret "node-exporter-tls" not found Jun 12 18:25:42.555376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.555245 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-textfile\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.555279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-accelerators-collector-config\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.555315 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-root\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.555359 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-sys\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555548 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.555488 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-wtmp\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.555674 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.555647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76e912ec-bbbc-4273-b9f8-5ab785960ecb-metrics-client-ca\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.557816 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.557793 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.566393 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.566372 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mksn\" (UniqueName: \"kubernetes.io/projected/76e912ec-bbbc-4273-b9f8-5ab785960ecb-kube-api-access-6mksn\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:42.958667 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.958562 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:42.961462 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:42.961435 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0b31b12-6297-4db5-912d-8a0c63f51b05-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-chhzv\" (UID: \"f0b31b12-6297-4db5-912d-8a0c63f51b05\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:43.059040 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:43.058996 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-tls\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:43.061722 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:43.061691 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76e912ec-bbbc-4273-b9f8-5ab785960ecb-node-exporter-tls\") pod \"node-exporter-mxx4r\" (UID: \"76e912ec-bbbc-4273-b9f8-5ab785960ecb\") " pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:43.240340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:43.240307 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" Jun 12 18:25:43.253676 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:43.253642 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mxx4r" Jun 12 18:25:46.371862 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:46.371815 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:25:46.372344 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:46.371875 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:25:46.917228 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:46.917195 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e912ec_bbbc_4273_b9f8_5ab785960ecb.slice/crio-7a2093cef9ca037e644af457618954b12b65229bd83da3256d8ab0af337c7669 WatchSource:0}: Error finding container 7a2093cef9ca037e644af457618954b12b65229bd83da3256d8ab0af337c7669: Status 404 returned error can't find the container with id 7a2093cef9ca037e644af457618954b12b65229bd83da3256d8ab0af337c7669 Jun 12 18:25:47.044947 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.044919 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-chhzv"] Jun 12 18:25:47.048175 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:47.048145 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b31b12_6297_4db5_912d_8a0c63f51b05.slice/crio-88b4c779de3fa15246793418279143b014dd40379d8cb859311c4f9747390090 WatchSource:0}: Error finding container 88b4c779de3fa15246793418279143b014dd40379d8cb859311c4f9747390090: Status 404 returned error can't find the container with id 88b4c779de3fa15246793418279143b014dd40379d8cb859311c4f9747390090 Jun 12 18:25:47.071463 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.071430 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cnvft"] Jun 12 18:25:47.073330 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.073311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.076402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.076372 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 18:25:47.076517 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.076497 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2m58f\"" Jun 12 18:25:47.090279 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.090251 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cnvft"] Jun 12 18:25:47.090506 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.090488 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e08de8e7-75c7-48e2-b157-a58d01843e5d-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.090547 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.090533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4g7c\" (UniqueName: \"kubernetes.io/projected/e08de8e7-75c7-48e2-b157-a58d01843e5d-kube-api-access-t4g7c\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.191485 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.191403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e08de8e7-75c7-48e2-b157-a58d01843e5d-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.191631 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.191491 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4g7c\" (UniqueName: \"kubernetes.io/projected/e08de8e7-75c7-48e2-b157-a58d01843e5d-kube-api-access-t4g7c\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.191631 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:47.191601 2557 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 18:25:47.191730 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:25:47.191671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e08de8e7-75c7-48e2-b157-a58d01843e5d-monitoring-plugin-cert podName:e08de8e7-75c7-48e2-b157-a58d01843e5d nodeName:}" failed. No retries permitted until 2026-06-12 18:25:47.691653767 +0000 UTC m=+237.260942178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/e08de8e7-75c7-48e2-b157-a58d01843e5d-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-cnvft" (UID: "e08de8e7-75c7-48e2-b157-a58d01843e5d") : secret "monitoring-plugin-cert" not found Jun 12 18:25:47.202920 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.202890 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4g7c\" (UniqueName: \"kubernetes.io/projected/e08de8e7-75c7-48e2-b157-a58d01843e5d-kube-api-access-t4g7c\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.576719 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.576678 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cd46785db-kj8px"] Jun 12 18:25:47.579885 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.579856 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.583101 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.583077 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cq69b\"" Jun 12 18:25:47.583252 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.583179 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 12 18:25:47.583317 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.583298 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 12 18:25:47.583790 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.583405 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 12 18:25:47.583790 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.583501 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 12 18:25:47.583790 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.583568 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 12 18:25:47.589026 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.588836 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 12 18:25:47.594776 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.594635 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cd46785db-kj8px"] Jun 12 18:25:47.608235 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.608198 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:25:47.608406 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.608262 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:25:47.677656 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.677622 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-n5d5t" event={"ID":"2d1bb578-0083-45e0-b6ef-1a129f8c2660","Type":"ContainerStarted","Data":"6028d351ad7e5c8de44f85a8efc2f741861bae2a2f0c8d70e7b8f112b835bd0a"} Jun 12 18:25:47.677924 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.677901 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:47.679482 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.679449 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxx4r" event={"ID":"76e912ec-bbbc-4273-b9f8-5ab785960ecb","Type":"ContainerStarted","Data":"7a2093cef9ca037e644af457618954b12b65229bd83da3256d8ab0af337c7669"} Jun 12 18:25:47.681073 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.681036 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" event={"ID":"f0b31b12-6297-4db5-912d-8a0c63f51b05","Type":"ContainerStarted","Data":"88b4c779de3fa15246793418279143b014dd40379d8cb859311c4f9747390090"} Jun 12 18:25:47.693665 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.693569 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-n5d5t" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-serving-certs-ca-bundle\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695318 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-telemeter-client-tls\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-secret-telemeter-client\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695461 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-federate-client-tls\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfqc8\" (UniqueName: \"kubernetes.io/projected/da7124df-490a-4730-96b5-e6cd14cd46e5-kube-api-access-cfqc8\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695528 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e08de8e7-75c7-48e2-b157-a58d01843e5d-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695536 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-n5d5t" podStartSLOduration=2.172447789 podStartE2EDuration="22.695517243s" totalImagesPullingTime="20.523069454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:47.693848346 +0000 UTC m=+237.263136810" watchObservedRunningTime="2026-06-12 18:25:47.695517243 +0000 UTC m=+237.264805677" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695614 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-metrics-client-ca\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.696365 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.695655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.698684 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.698636 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e08de8e7-75c7-48e2-b157-a58d01843e5d-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-cnvft\" (UID: \"e08de8e7-75c7-48e2-b157-a58d01843e5d\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:47.796089 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-telemeter-client-tls\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796281 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796113 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-secret-telemeter-client\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796281 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796183 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-federate-client-tls\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796281 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfqc8\" (UniqueName: \"kubernetes.io/projected/da7124df-490a-4730-96b5-e6cd14cd46e5-kube-api-access-cfqc8\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796281 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796244 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-metrics-client-ca\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796601 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796285 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796601 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-serving-certs-ca-bundle\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.796601 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.796376 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.797240 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.797209 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-metrics-client-ca\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.798127 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.798100 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.798278 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.798251 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da7124df-490a-4730-96b5-e6cd14cd46e5-serving-certs-ca-bundle\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.799896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.799621 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-secret-telemeter-client\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.799896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.799659 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.799896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.799861 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-telemeter-client-tls\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.800624 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.800566 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da7124df-490a-4730-96b5-e6cd14cd46e5-federate-client-tls\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.806519 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.806496 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfqc8\" (UniqueName: \"kubernetes.io/projected/da7124df-490a-4730-96b5-e6cd14cd46e5-kube-api-access-cfqc8\") pod \"telemeter-client-6cd46785db-kj8px\" (UID: \"da7124df-490a-4730-96b5-e6cd14cd46e5\") " pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.894006 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.893969 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" Jun 12 18:25:47.982907 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:47.982876 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:48.070356 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:48.070317 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cd46785db-kj8px"] Jun 12 18:25:48.174198 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:48.174160 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-cnvft"] Jun 12 18:25:48.179933 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:25:48.179902 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08de8e7_75c7_48e2_b157_a58d01843e5d.slice/crio-42bbefebf8ca7d8a29f28e1d9f21741911f523459ed552ac594115e761da5605 WatchSource:0}: Error finding container 42bbefebf8ca7d8a29f28e1d9f21741911f523459ed552ac594115e761da5605: Status 404 returned error can't find the container with id 42bbefebf8ca7d8a29f28e1d9f21741911f523459ed552ac594115e761da5605 Jun 12 18:25:48.688534 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:48.688494 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" event={"ID":"da7124df-490a-4730-96b5-e6cd14cd46e5","Type":"ContainerStarted","Data":"a80b2b0c68436c245b785d7f156948dab892637cb5fb9e388112810f18cec0f4"} Jun 12 18:25:48.690530 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:48.690465 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" event={"ID":"e08de8e7-75c7-48e2-b157-a58d01843e5d","Type":"ContainerStarted","Data":"42bbefebf8ca7d8a29f28e1d9f21741911f523459ed552ac594115e761da5605"} Jun 12 18:25:48.693625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:48.693591 2557 generic.go:356] "Generic (PLEG): container finished" podID="76e912ec-bbbc-4273-b9f8-5ab785960ecb" containerID="2b5faacd3fb36e3fc3012179d993c343cd8d4c4f30ed3b5f70e7ea4c85788e0f" exitCode=0 Jun 12 18:25:48.693873 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:48.693815 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxx4r" event={"ID":"76e912ec-bbbc-4273-b9f8-5ab785960ecb","Type":"ContainerDied","Data":"2b5faacd3fb36e3fc3012179d993c343cd8d4c4f30ed3b5f70e7ea4c85788e0f"} Jun 12 18:25:49.716255 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:49.714330 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxx4r" event={"ID":"76e912ec-bbbc-4273-b9f8-5ab785960ecb","Type":"ContainerStarted","Data":"9ecad4542e2de98ce7fe2d714fa26f4090af566274c741f3eec5a1f298029bc5"} Jun 12 18:25:49.716255 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:49.714453 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mxx4r" event={"ID":"76e912ec-bbbc-4273-b9f8-5ab785960ecb","Type":"ContainerStarted","Data":"ecd1335541b5f780bd01066fbf844d5a2bf30e1c3d3160c1f3a7398cbcd1fa4b"} Jun 12 18:25:49.722495 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:49.722368 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" event={"ID":"f0b31b12-6297-4db5-912d-8a0c63f51b05","Type":"ContainerStarted","Data":"bf7fa81f6798d2eacf391c730ad844158ba3b0694a9449c5c58cf1ad83435511"} Jun 12 18:25:49.722495 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:49.722448 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" event={"ID":"f0b31b12-6297-4db5-912d-8a0c63f51b05","Type":"ContainerStarted","Data":"44fc4e7e2b370b7bf13c4aa5253f7e1231cbdb608bf14305e2836acdc3272dd8"} Jun 12 18:25:49.734643 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:49.734518 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mxx4r" podStartSLOduration=6.7735736 podStartE2EDuration="7.734498183s" totalImagesPullingTime="871.337252ms" totalInitContainerRuntime="89.587331ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:49.733038538 +0000 UTC m=+239.302327037" watchObservedRunningTime="2026-06-12 18:25:49.734498183 +0000 UTC m=+239.303786613" Jun 12 18:25:51.731627 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.731566 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" event={"ID":"e08de8e7-75c7-48e2-b157-a58d01843e5d","Type":"ContainerStarted","Data":"db76f3414ac83c7c1cd1ccc764dd2668d0d0c2a3b5ba086f9e9c870409c76cf5"} Jun 12 18:25:51.732128 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.731735 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:51.734668 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.734339 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" event={"ID":"f0b31b12-6297-4db5-912d-8a0c63f51b05","Type":"ContainerStarted","Data":"d7a6ca978f09d40dd23641b04854fb7f62460e08f8fecea8c608a7ccd372e1ca"} Jun 12 18:25:51.738615 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.736465 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" event={"ID":"da7124df-490a-4730-96b5-e6cd14cd46e5","Type":"ContainerStarted","Data":"5ebde4469b0cd5c7dd91a96206825efbbb82bb040c9bf9cae38cd013990ee834"} Jun 12 18:25:51.743935 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.743907 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" Jun 12 18:25:51.756181 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.756134 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-cnvft" podStartSLOduration=1.726192013 podStartE2EDuration="4.756120497s" totalImagesPullingTime="3.029928484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:51.755851118 +0000 UTC m=+241.325139551" watchObservedRunningTime="2026-06-12 18:25:51.756120497 +0000 UTC m=+241.325408925" Jun 12 18:25:51.790892 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:51.790830 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-chhzv" podStartSLOduration=7.459526429 podStartE2EDuration="9.79081014s" totalImagesPullingTime="2.331283711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:51.789241248 +0000 UTC m=+241.358529703" watchObservedRunningTime="2026-06-12 18:25:51.79081014 +0000 UTC m=+241.360098571" Jun 12 18:25:53.747823 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:53.747787 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" event={"ID":"da7124df-490a-4730-96b5-e6cd14cd46e5","Type":"ContainerStarted","Data":"5482e75b0b34a2b090683948e49737574d12052c496c69541cd93ac3ac4eb3a5"} Jun 12 18:25:53.748296 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:53.747845 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" event={"ID":"da7124df-490a-4730-96b5-e6cd14cd46e5","Type":"ContainerStarted","Data":"120b98e2fd06278968519ecb30bcf898f95d6aa585677393dd31e4dac1f602c3"} Jun 12 18:25:53.773438 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:53.773369 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cd46785db-kj8px" podStartSLOduration=2.109339716 podStartE2EDuration="6.773349246s" totalImagesPullingTime="4.66400953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:53.772661884 +0000 UTC m=+243.341950318" watchObservedRunningTime="2026-06-12 18:25:53.773349246 +0000 UTC m=+243.342637679" Jun 12 18:25:56.372149 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:56.372116 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:25:56.372541 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:56.372169 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:25:57.606728 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:57.606695 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:25:57.607176 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:25:57.606742 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:26:02.733111 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:02.733077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:26:02.735430 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:02.735406 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/095457ce-f584-46da-9ac8-c9d3b8d610a4-metrics-certs\") pod \"network-metrics-daemon-grvbq\" (UID: \"095457ce-f584-46da-9ac8-c9d3b8d610a4\") " pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:26:03.014971 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:03.014900 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kk7mw\"" Jun 12 18:26:03.023148 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:03.023126 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grvbq" Jun 12 18:26:03.170536 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:03.170509 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grvbq"] Jun 12 18:26:03.173342 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:26:03.173313 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095457ce_f584_46da_9ac8_c9d3b8d610a4.slice/crio-f0b9171d5ff0b0913a6a83619fa11e4e2e8404b4c90ec24ac134f542f15901ec WatchSource:0}: Error finding container f0b9171d5ff0b0913a6a83619fa11e4e2e8404b4c90ec24ac134f542f15901ec: Status 404 returned error can't find the container with id f0b9171d5ff0b0913a6a83619fa11e4e2e8404b4c90ec24ac134f542f15901ec Jun 12 18:26:03.785861 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:03.785818 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grvbq" event={"ID":"095457ce-f584-46da-9ac8-c9d3b8d610a4","Type":"ContainerStarted","Data":"f0b9171d5ff0b0913a6a83619fa11e4e2e8404b4c90ec24ac134f542f15901ec"} Jun 12 18:26:04.790984 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:04.790957 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grvbq" event={"ID":"095457ce-f584-46da-9ac8-c9d3b8d610a4","Type":"ContainerStarted","Data":"1858f238dc89367770b534ed8d35c6facf2d720fef0c6baffd84cf4dfcdec808"} Jun 12 18:26:05.796174 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:05.796137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grvbq" event={"ID":"095457ce-f584-46da-9ac8-c9d3b8d610a4","Type":"ContainerStarted","Data":"47b0d8b2b32f9949fe1604ff5786d8dc298080c4b081988c15bba6325c167a29"} Jun 12 18:26:05.811729 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:05.811677 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-grvbq" podStartSLOduration=253.472107784 podStartE2EDuration="4m14.811661895s" totalImagesPullingTime="1.339554111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:26:05.811166812 +0000 UTC m=+255.380455236" watchObservedRunningTime="2026-06-12 18:26:05.811661895 +0000 UTC m=+255.380950338" Jun 12 18:26:06.371189 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:06.371152 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:26:06.371347 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:06.371201 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:26:06.371347 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:06.371238 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:26:06.371680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:06.371653 2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"3c82d21302ec7f64027ceac3bc9f0c477bd5993cd2d3229bf52ba6f6f0192fcd"} pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" containerMessage="Container registry failed liveness probe, will be restarted" Jun 12 18:26:06.375155 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:06.375122 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:26:06.375266 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:06.375168 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:26:16.375835 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:16.375755 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:26:16.375835 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:16.375812 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:26:26.230404 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:26.230374 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-d9hpx_335eacfa-8e80-40b8-9b7e-0dfc82013f9f/cluster-monitoring-operator/0.log" Jun 12 18:26:26.375524 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:26.375489 2557 patch_prober.go:28] interesting pod/image-registry-ffd8d99c7-wjq75 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:26:26.375743 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:26.375552 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:26:26.429359 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:26.429335 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-chhzv_f0b31b12-6297-4db5-912d-8a0c63f51b05/kube-state-metrics/0.log" Jun 12 18:26:26.628350 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:26.628274 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-chhzv_f0b31b12-6297-4db5-912d-8a0c63f51b05/kube-rbac-proxy-main/0.log" Jun 12 18:26:26.829300 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:26.829267 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-chhzv_f0b31b12-6297-4db5-912d-8a0c63f51b05/kube-rbac-proxy-self/0.log" Jun 12 18:26:27.228777 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:27.228750 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-cnvft_e08de8e7-75c7-48e2-b157-a58d01843e5d/monitoring-plugin/0.log" Jun 12 18:26:28.628121 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:28.628095 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxx4r_76e912ec-bbbc-4273-b9f8-5ab785960ecb/init-textfile/0.log" Jun 12 18:26:28.829823 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:28.829800 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxx4r_76e912ec-bbbc-4273-b9f8-5ab785960ecb/node-exporter/0.log" Jun 12 18:26:29.029507 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:29.029483 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxx4r_76e912ec-bbbc-4273-b9f8-5ab785960ecb/kube-rbac-proxy/0.log" Jun 12 18:26:31.390478 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:31.390423 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" podUID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerName="registry" containerID="cri-o://3c82d21302ec7f64027ceac3bc9f0c477bd5993cd2d3229bf52ba6f6f0192fcd" gracePeriod=30 Jun 12 18:26:31.828957 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:31.828924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd46785db-kj8px_da7124df-490a-4730-96b5-e6cd14cd46e5/telemeter-client/0.log" Jun 12 18:26:32.029273 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:32.029241 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd46785db-kj8px_da7124df-490a-4730-96b5-e6cd14cd46e5/reload/0.log" Jun 12 18:26:32.229712 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:32.229690 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd46785db-kj8px_da7124df-490a-4730-96b5-e6cd14cd46e5/kube-rbac-proxy/0.log" Jun 12 18:26:32.890379 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:32.890302 2557 generic.go:356] "Generic (PLEG): container finished" podID="11946b1b-1832-4299-ad35-a877ae2e6efe" containerID="3c82d21302ec7f64027ceac3bc9f0c477bd5993cd2d3229bf52ba6f6f0192fcd" exitCode=0 Jun 12 18:26:32.890765 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:32.890373 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" event={"ID":"11946b1b-1832-4299-ad35-a877ae2e6efe","Type":"ContainerDied","Data":"3c82d21302ec7f64027ceac3bc9f0c477bd5993cd2d3229bf52ba6f6f0192fcd"} Jun 12 18:26:32.890765 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:32.890417 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" event={"ID":"11946b1b-1832-4299-ad35-a877ae2e6efe","Type":"ContainerStarted","Data":"78bc0361a131861aa4bf17c42108afd3eeb3ae97f68b1e72e368101a3e917d52"} Jun 12 18:26:32.890765 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:32.890459 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:26:33.428155 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:26:33.428113 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4b6df" podUID="da42943f-19b8-4c9a-a2a6-4e1070faef1b" Jun 12 18:26:33.893427 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:33.893394 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4b6df" Jun 12 18:26:35.031248 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:35.031197 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-n5d5t_2d1bb578-0083-45e0-b6ef-1a129f8c2660/download-server/0.log" Jun 12 18:26:36.430031 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:36.430005 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fqc2q_9cd5e1fc-6e2d-4494-879d-e524012db41c/dns-node-resolver/0.log" Jun 12 18:26:36.807906 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:36.807858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:26:36.810205 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:36.810178 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/da42943f-19b8-4c9a-a2a6-4e1070faef1b-metrics-tls\") pod \"dns-default-4b6df\" (UID: \"da42943f-19b8-4c9a-a2a6-4e1070faef1b\") " pod="openshift-dns/dns-default-4b6df" Jun 12 18:26:36.896959 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:36.896927 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5r6\"" Jun 12 18:26:36.904649 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:36.904629 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4b6df" Jun 12 18:26:37.035152 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:37.035122 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4b6df"] Jun 12 18:26:37.038062 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:26:37.038035 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda42943f_19b8_4c9a_a2a6_4e1070faef1b.slice/crio-9a2c4434c72d41e35a122b16ad767f88f33bf023dba052f1fcb1e4a1bf0d88cf WatchSource:0}: Error finding container 9a2c4434c72d41e35a122b16ad767f88f33bf023dba052f1fcb1e4a1bf0d88cf: Status 404 returned error can't find the container with id 9a2c4434c72d41e35a122b16ad767f88f33bf023dba052f1fcb1e4a1bf0d88cf Jun 12 18:26:37.230624 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:37.230568 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-ffd8d99c7-wjq75_11946b1b-1832-4299-ad35-a877ae2e6efe/registry/1.log" Jun 12 18:26:37.430030 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:37.429981 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wc2q_f69d0418-750d-4952-9161-9d2e947db538/node-ca/0.log" Jun 12 18:26:37.912733 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:37.912698 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4b6df" event={"ID":"da42943f-19b8-4c9a-a2a6-4e1070faef1b","Type":"ContainerStarted","Data":"9a2c4434c72d41e35a122b16ad767f88f33bf023dba052f1fcb1e4a1bf0d88cf"} Jun 12 18:26:38.429914 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:38.429882 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dsgj9_c3d71330-055d-42db-ab4d-ba8feed28ad0/serve-healthcheck-canary/0.log" Jun 12 18:26:38.918145 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:38.918116 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4b6df" event={"ID":"da42943f-19b8-4c9a-a2a6-4e1070faef1b","Type":"ContainerStarted","Data":"1646b82c9276334219c555276accf6df442ef333d51c9f58a4214fc96080a0ce"} Jun 12 18:26:38.918514 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:38.918168 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4b6df" event={"ID":"da42943f-19b8-4c9a-a2a6-4e1070faef1b","Type":"ContainerStarted","Data":"6fa95bfb6d6f0983b97a134b950ea9df03efb1764447686475a690601e483df4"} Jun 12 18:26:38.918514 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:38.918235 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4b6df" Jun 12 18:26:38.936138 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:38.936090 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4b6df" podStartSLOduration=251.472676891 podStartE2EDuration="4m12.936073653s" totalImagesPullingTime="1.463396762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:26:38.934795382 +0000 UTC m=+288.504083832" watchObservedRunningTime="2026-06-12 18:26:38.936073653 +0000 UTC m=+288.505362083" Jun 12 18:26:48.926595 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:48.926559 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4b6df" Jun 12 18:26:50.862333 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:50.862306 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:26:50.865064 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:50.865046 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:26:50.865801 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:50.865786 2557 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:26:53.898361 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:26:53.898333 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-ffd8d99c7-wjq75" Jun 12 18:27:04.046402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.046366 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:27:04.053523 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.053495 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.055942 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.055919 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 18:27:04.056146 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056011 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9pxv6\"" Jun 12 18:27:04.056238 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056223 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 18:27:04.056297 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056264 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 18:27:04.056352 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056297 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 18:27:04.056352 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056306 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 18:27:04.056352 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056338 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 18:27:04.056625 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056549 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 18:27:04.056756 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.056739 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 18:27:04.062157 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.062121 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 18:27:04.068145 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.068120 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:27:04.112483 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112450 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbfb868-fe80-47d2-af2d-77142bfebb82-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112483 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112715 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112513 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7bfx\" (UniqueName: \"kubernetes.io/projected/9fbfb868-fe80-47d2-af2d-77142bfebb82-kube-api-access-h7bfx\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112715 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112715 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbfb868-fe80-47d2-af2d-77142bfebb82-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112715 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbfb868-fe80-47d2-af2d-77142bfebb82-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112715 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112670 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112715 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-web-config\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112913 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112913 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112785 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112913 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112805 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbfb868-fe80-47d2-af2d-77142bfebb82-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112913 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbfb868-fe80-47d2-af2d-77142bfebb82-config-out\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.112913 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.112888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.213800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.213757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.213800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.213802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbfb868-fe80-47d2-af2d-77142bfebb82-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214061 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214039 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbfb868-fe80-47d2-af2d-77142bfebb82-config-out\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214123 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214090 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214123 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214113 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbfb868-fe80-47d2-af2d-77142bfebb82-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214160 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7bfx\" (UniqueName: \"kubernetes.io/projected/9fbfb868-fe80-47d2-af2d-77142bfebb82-kube-api-access-h7bfx\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214176 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbfb868-fe80-47d2-af2d-77142bfebb82-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214434 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214239 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbfb868-fe80-47d2-af2d-77142bfebb82-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214434 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214267 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214434 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214290 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-web-config\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.214434 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214334 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.215340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.214864 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fbfb868-fe80-47d2-af2d-77142bfebb82-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.215340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.215244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fbfb868-fe80-47d2-af2d-77142bfebb82-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.216927 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.216898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.216936 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fbfb868-fe80-47d2-af2d-77142bfebb82-config-out\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217104 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217045 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fbfb868-fe80-47d2-af2d-77142bfebb82-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217104 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217096 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217227 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217208 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fbfb868-fe80-47d2-af2d-77142bfebb82-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217441 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217421 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217801 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217782 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217882 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217867 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.217950 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.217931 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.218942 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.218923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fbfb868-fe80-47d2-af2d-77142bfebb82-web-config\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.227561 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.227539 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7bfx\" (UniqueName: \"kubernetes.io/projected/9fbfb868-fe80-47d2-af2d-77142bfebb82-kube-api-access-h7bfx\") pod \"alertmanager-main-0\" (UID: \"9fbfb868-fe80-47d2-af2d-77142bfebb82\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.364240 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.364157 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:04.498623 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:04.498596 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:27:04.500449 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:27:04.500423 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbfb868_fe80_47d2_af2d_77142bfebb82.slice/crio-b605843d6f988e46864e62faad4cb7a467745098c5f035545452b3922645374b WatchSource:0}: Error finding container b605843d6f988e46864e62faad4cb7a467745098c5f035545452b3922645374b: Status 404 returned error can't find the container with id b605843d6f988e46864e62faad4cb7a467745098c5f035545452b3922645374b Jun 12 18:27:05.011411 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:05.011379 2557 generic.go:356] "Generic (PLEG): container finished" podID="9fbfb868-fe80-47d2-af2d-77142bfebb82" containerID="5e78c79bbf84014cb3e1cc675bbeba261a88df18cac72cb2ace61f1345fb47bf" exitCode=0 Jun 12 18:27:05.011606 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:05.011419 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerDied","Data":"5e78c79bbf84014cb3e1cc675bbeba261a88df18cac72cb2ace61f1345fb47bf"} Jun 12 18:27:05.011606 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:05.011471 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"b605843d6f988e46864e62faad4cb7a467745098c5f035545452b3922645374b"} Jun 12 18:27:05.012564 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:05.012547 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:27:07.021024 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:07.020989 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"d5cf96360fb30acbcc996ddaa9b2a03c0e8976dfdb94b3b4f0895561a237c49b"} Jun 12 18:27:07.021432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:07.021063 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"852aa2a7348875237d8c803aa6a2f540fddfa50e65ed7e12b34088cd6e365e02"} Jun 12 18:27:07.021432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:07.021103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"063c144cde5664bfe2f7d0ee19de39d8ac93e26454ded9b7bcc799cab28e3148"} Jun 12 18:27:07.021432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:07.021142 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"832194266fca57a83572985f5975e236b218988df2f659f222d05ae1513b4449"} Jun 12 18:27:07.021432 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:07.021184 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"a91a9c19bfa408f1f1f454021668643e453363c334e6015c175eb5aae9714969"} Jun 12 18:27:08.027645 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:08.027605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fbfb868-fe80-47d2-af2d-77142bfebb82","Type":"ContainerStarted","Data":"fff8794468981b042b039b8067161d4a5b21ce05feafc9ef631d2d664dd6f118"} Jun 12 18:27:08.056832 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:27:08.056777 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.392392097 podStartE2EDuration="4.056762766s" totalImagesPullingTime="2.650657328s" totalInitContainerRuntime="13.713341ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:27:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:27:08.054700743 +0000 UTC m=+317.623989187" watchObservedRunningTime="2026-06-12 18:27:08.056762766 +0000 UTC m=+317.626051196" Jun 12 18:28:36.873907 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:36.873877 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-65xbx"] Jun 12 18:28:36.876986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:36.876961 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:36.879825 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:36.879807 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 12 18:28:36.879931 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:36.879846 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-z5qdd\"" Jun 12 18:28:36.880874 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:36.880858 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 12 18:28:36.901936 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:36.901902 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-65xbx"] Jun 12 18:28:37.062503 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.062472 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh56w\" (UniqueName: \"kubernetes.io/projected/e882ff91-bec1-4084-8c79-df98c0e38bae-kube-api-access-gh56w\") pod \"cert-manager-59c77684cc-65xbx\" (UID: \"e882ff91-bec1-4084-8c79-df98c0e38bae\") " pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.062737 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.062516 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e882ff91-bec1-4084-8c79-df98c0e38bae-bound-sa-token\") pod \"cert-manager-59c77684cc-65xbx\" (UID: \"e882ff91-bec1-4084-8c79-df98c0e38bae\") " pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.163642 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.163523 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e882ff91-bec1-4084-8c79-df98c0e38bae-bound-sa-token\") pod \"cert-manager-59c77684cc-65xbx\" (UID: \"e882ff91-bec1-4084-8c79-df98c0e38bae\") " pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.163642 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.163635 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh56w\" (UniqueName: \"kubernetes.io/projected/e882ff91-bec1-4084-8c79-df98c0e38bae-kube-api-access-gh56w\") pod \"cert-manager-59c77684cc-65xbx\" (UID: \"e882ff91-bec1-4084-8c79-df98c0e38bae\") " pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.174040 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.174012 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e882ff91-bec1-4084-8c79-df98c0e38bae-bound-sa-token\") pod \"cert-manager-59c77684cc-65xbx\" (UID: \"e882ff91-bec1-4084-8c79-df98c0e38bae\") " pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.174312 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.174291 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh56w\" (UniqueName: \"kubernetes.io/projected/e882ff91-bec1-4084-8c79-df98c0e38bae-kube-api-access-gh56w\") pod \"cert-manager-59c77684cc-65xbx\" (UID: \"e882ff91-bec1-4084-8c79-df98c0e38bae\") " pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.186124 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.186101 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-65xbx" Jun 12 18:28:37.333459 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.333420 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-65xbx"] Jun 12 18:28:37.336737 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:28:37.336710 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode882ff91_bec1_4084_8c79_df98c0e38bae.slice/crio-2e478299db6590c8f977bfbaa1713ac9c2ac3ed7eb6b773275179e7f9b33d4ce WatchSource:0}: Error finding container 2e478299db6590c8f977bfbaa1713ac9c2ac3ed7eb6b773275179e7f9b33d4ce: Status 404 returned error can't find the container with id 2e478299db6590c8f977bfbaa1713ac9c2ac3ed7eb6b773275179e7f9b33d4ce Jun 12 18:28:37.352893 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:37.352866 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-65xbx" event={"ID":"e882ff91-bec1-4084-8c79-df98c0e38bae","Type":"ContainerStarted","Data":"2e478299db6590c8f977bfbaa1713ac9c2ac3ed7eb6b773275179e7f9b33d4ce"} Jun 12 18:28:41.369289 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:41.369251 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-65xbx" event={"ID":"e882ff91-bec1-4084-8c79-df98c0e38bae","Type":"ContainerStarted","Data":"601ffae11aca73e155cfddedad66f1153ddda1fdb5cf4cf53116439479c608a2"} Jun 12 18:28:41.394039 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:41.393991 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-65xbx" podStartSLOduration=1.8747982890000001 podStartE2EDuration="5.393975951s" totalImagesPullingTime="3.519177662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:28:41.392903316 +0000 UTC m=+410.962191767" watchObservedRunningTime="2026-06-12 18:28:41.393975951 +0000 UTC m=+410.963264381" Jun 12 18:28:54.825953 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.825916 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7"] Jun 12 18:28:54.829328 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.829311 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:54.834995 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.834974 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:28:54.835812 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.835796 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:28:54.836994 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.836969 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:28:54.837097 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.837026 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fk847\"" Jun 12 18:28:54.837461 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.837447 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:28:54.865660 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.865630 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7"] Jun 12 18:28:54.902522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.902491 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrskd\" (UniqueName: \"kubernetes.io/projected/a60ec38d-95dc-4d1f-979b-299fecc48f19-kube-api-access-qrskd\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:54.902522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.902527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a60ec38d-95dc-4d1f-979b-299fecc48f19-tmp\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:54.902757 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.902565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a60ec38d-95dc-4d1f-979b-299fecc48f19-manifests\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:54.902757 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.902631 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a60ec38d-95dc-4d1f-979b-299fecc48f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:54.902757 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:54.902680 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a60ec38d-95dc-4d1f-979b-299fecc48f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.003376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.003337 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrskd\" (UniqueName: \"kubernetes.io/projected/a60ec38d-95dc-4d1f-979b-299fecc48f19-kube-api-access-qrskd\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.003376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.003383 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a60ec38d-95dc-4d1f-979b-299fecc48f19-tmp\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.003670 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.003433 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a60ec38d-95dc-4d1f-979b-299fecc48f19-manifests\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.003670 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.003449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a60ec38d-95dc-4d1f-979b-299fecc48f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.003670 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.003467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a60ec38d-95dc-4d1f-979b-299fecc48f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.003853 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.003830 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a60ec38d-95dc-4d1f-979b-299fecc48f19-manifests\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.005823 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.005793 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a60ec38d-95dc-4d1f-979b-299fecc48f19-tmp\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.006087 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.006068 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a60ec38d-95dc-4d1f-979b-299fecc48f19-webhook-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.006130 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.006108 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a60ec38d-95dc-4d1f-979b-299fecc48f19-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.019213 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.019183 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrskd\" (UniqueName: \"kubernetes.io/projected/a60ec38d-95dc-4d1f-979b-299fecc48f19-kube-api-access-qrskd\") pod \"opendatahub-operator-controller-manager-5877f56774-n6gv7\" (UID: \"a60ec38d-95dc-4d1f-979b-299fecc48f19\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.139605 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.139478 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:28:55.291307 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.291230 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7"] Jun 12 18:28:55.294847 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:28:55.294819 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60ec38d_95dc_4d1f_979b_299fecc48f19.slice/crio-6048b92bba3981bff05143764a8bba3c833e30c0c27137f18b610c69ffe9d7a5 WatchSource:0}: Error finding container 6048b92bba3981bff05143764a8bba3c833e30c0c27137f18b610c69ffe9d7a5: Status 404 returned error can't find the container with id 6048b92bba3981bff05143764a8bba3c833e30c0c27137f18b610c69ffe9d7a5 Jun 12 18:28:55.422836 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:55.422754 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" event={"ID":"a60ec38d-95dc-4d1f-979b-299fecc48f19","Type":"ContainerStarted","Data":"6048b92bba3981bff05143764a8bba3c833e30c0c27137f18b610c69ffe9d7a5"} Jun 12 18:28:58.438376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:28:58.438338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" event={"ID":"a60ec38d-95dc-4d1f-979b-299fecc48f19","Type":"ContainerStarted","Data":"6ce9d8f1d12c043e3ab805275e6ac16cd16b233071e981e2eae0f13130d264ae"} Jun 12 18:29:00.448138 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:00.448106 2557 generic.go:356] "Generic (PLEG): container finished" podID="a60ec38d-95dc-4d1f-979b-299fecc48f19" containerID="6ce9d8f1d12c043e3ab805275e6ac16cd16b233071e981e2eae0f13130d264ae" exitCode=0 Jun 12 18:29:00.448641 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:00.448182 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" event={"ID":"a60ec38d-95dc-4d1f-979b-299fecc48f19","Type":"ContainerDied","Data":"6ce9d8f1d12c043e3ab805275e6ac16cd16b233071e981e2eae0f13130d264ae"} Jun 12 18:29:01.454066 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:01.454030 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" event={"ID":"a60ec38d-95dc-4d1f-979b-299fecc48f19","Type":"ContainerStarted","Data":"59b7fa05586a44a0e8e9951322c89a9279d498c47dfd97afee2c7d343d8eacc0"} Jun 12 18:29:01.454443 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:01.454353 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:29:01.504540 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:01.504491 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" podStartSLOduration=3.090270126 podStartE2EDuration="7.504473861s" totalImagesPullingTime="3.362445367s" totalInitContainerRuntime="1.051758368s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:28:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:01.501597183 +0000 UTC m=+431.070885604" watchObservedRunningTime="2026-06-12 18:29:01.504473861 +0000 UTC m=+431.073762291" Jun 12 18:29:12.461509 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:12.461429 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-n6gv7" Jun 12 18:29:19.879827 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.879794 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9"] Jun 12 18:29:19.886614 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.886591 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:19.889158 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.889075 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:29:19.889294 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.889191 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:29:19.890551 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.890526 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8xpvz\"" Jun 12 18:29:19.890718 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.890696 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:29:19.890806 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.890551 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:29:19.895335 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:19.895311 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9"] Jun 12 18:29:20.004361 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.004325 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80bce672-2bbf-4007-95f2-8d09797003b8-tmp\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.004537 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.004379 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bce672-2bbf-4007-95f2-8d09797003b8-tls-certs\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.004537 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.004410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78cbs\" (UniqueName: \"kubernetes.io/projected/80bce672-2bbf-4007-95f2-8d09797003b8-kube-api-access-78cbs\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.073844 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.073809 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-shcqs"] Jun 12 18:29:20.076087 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.076067 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.078513 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.078492 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 12 18:29:20.078652 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.078600 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w2lw6\"" Jun 12 18:29:20.087068 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.087039 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-shcqs"] Jun 12 18:29:20.104926 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.104892 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bce672-2bbf-4007-95f2-8d09797003b8-tls-certs\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.105116 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.104942 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78cbs\" (UniqueName: \"kubernetes.io/projected/80bce672-2bbf-4007-95f2-8d09797003b8-kube-api-access-78cbs\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.105116 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.105018 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80bce672-2bbf-4007-95f2-8d09797003b8-tmp\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.107863 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.107835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80bce672-2bbf-4007-95f2-8d09797003b8-tmp\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.108015 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.107999 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80bce672-2bbf-4007-95f2-8d09797003b8-tls-certs\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.114261 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.114235 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78cbs\" (UniqueName: \"kubernetes.io/projected/80bce672-2bbf-4007-95f2-8d09797003b8-kube-api-access-78cbs\") pod \"kube-auth-proxy-6bf5d68d87-fxsk9\" (UID: \"80bce672-2bbf-4007-95f2-8d09797003b8\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.198719 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.198629 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" Jun 12 18:29:20.205897 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.205870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7374151-e679-415c-a3dc-cb49a7e4c8c7-cert\") pod \"odh-model-controller-6dc94f689f-shcqs\" (UID: \"a7374151-e679-415c-a3dc-cb49a7e4c8c7\") " pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.206009 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.205908 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skxvs\" (UniqueName: \"kubernetes.io/projected/a7374151-e679-415c-a3dc-cb49a7e4c8c7-kube-api-access-skxvs\") pod \"odh-model-controller-6dc94f689f-shcqs\" (UID: \"a7374151-e679-415c-a3dc-cb49a7e4c8c7\") " pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.307224 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.307194 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7374151-e679-415c-a3dc-cb49a7e4c8c7-cert\") pod \"odh-model-controller-6dc94f689f-shcqs\" (UID: \"a7374151-e679-415c-a3dc-cb49a7e4c8c7\") " pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.307400 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.307234 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skxvs\" (UniqueName: \"kubernetes.io/projected/a7374151-e679-415c-a3dc-cb49a7e4c8c7-kube-api-access-skxvs\") pod \"odh-model-controller-6dc94f689f-shcqs\" (UID: \"a7374151-e679-415c-a3dc-cb49a7e4c8c7\") " pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.309778 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.309751 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7374151-e679-415c-a3dc-cb49a7e4c8c7-cert\") pod \"odh-model-controller-6dc94f689f-shcqs\" (UID: \"a7374151-e679-415c-a3dc-cb49a7e4c8c7\") " pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.316987 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.316959 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skxvs\" (UniqueName: \"kubernetes.io/projected/a7374151-e679-415c-a3dc-cb49a7e4c8c7-kube-api-access-skxvs\") pod \"odh-model-controller-6dc94f689f-shcqs\" (UID: \"a7374151-e679-415c-a3dc-cb49a7e4c8c7\") " pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.326934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.326899 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9"] Jun 12 18:29:20.329050 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:20.329020 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bce672_2bbf_4007_95f2_8d09797003b8.slice/crio-9973ecf6df4fe946ad4e855c2e9caf005e3ea648feea2b966a6078a3e670f794 WatchSource:0}: Error finding container 9973ecf6df4fe946ad4e855c2e9caf005e3ea648feea2b966a6078a3e670f794: Status 404 returned error can't find the container with id 9973ecf6df4fe946ad4e855c2e9caf005e3ea648feea2b966a6078a3e670f794 Jun 12 18:29:20.388066 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.388028 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:20.528443 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.528410 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-shcqs"] Jun 12 18:29:20.530403 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:20.530379 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7374151_e679_415c_a3dc_cb49a7e4c8c7.slice/crio-d329116445d70dca649160754503bf2b4d7bbba71072e60dcf032975c23709bb WatchSource:0}: Error finding container d329116445d70dca649160754503bf2b4d7bbba71072e60dcf032975c23709bb: Status 404 returned error can't find the container with id d329116445d70dca649160754503bf2b4d7bbba71072e60dcf032975c23709bb Jun 12 18:29:20.534741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.534710 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" event={"ID":"80bce672-2bbf-4007-95f2-8d09797003b8","Type":"ContainerStarted","Data":"9973ecf6df4fe946ad4e855c2e9caf005e3ea648feea2b966a6078a3e670f794"} Jun 12 18:29:20.687862 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.687826 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-x77f5"] Jun 12 18:29:20.690552 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.690532 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:20.693018 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.692995 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-d4wnz\"" Jun 12 18:29:20.693121 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.693109 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 12 18:29:20.702015 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.701992 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-x77f5"] Jun 12 18:29:20.810192 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.810108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61354af9-1ed4-4859-8bb1-ba2691b2ad73-tls-certs\") pod \"model-serving-api-5dd488fc48-x77f5\" (UID: \"61354af9-1ed4-4859-8bb1-ba2691b2ad73\") " pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:20.810192 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.810146 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92cbf\" (UniqueName: \"kubernetes.io/projected/61354af9-1ed4-4859-8bb1-ba2691b2ad73-kube-api-access-92cbf\") pod \"model-serving-api-5dd488fc48-x77f5\" (UID: \"61354af9-1ed4-4859-8bb1-ba2691b2ad73\") " pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:20.911523 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.911481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61354af9-1ed4-4859-8bb1-ba2691b2ad73-tls-certs\") pod \"model-serving-api-5dd488fc48-x77f5\" (UID: \"61354af9-1ed4-4859-8bb1-ba2691b2ad73\") " pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:20.911934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.911536 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92cbf\" (UniqueName: \"kubernetes.io/projected/61354af9-1ed4-4859-8bb1-ba2691b2ad73-kube-api-access-92cbf\") pod \"model-serving-api-5dd488fc48-x77f5\" (UID: \"61354af9-1ed4-4859-8bb1-ba2691b2ad73\") " pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:20.913962 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.913939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61354af9-1ed4-4859-8bb1-ba2691b2ad73-tls-certs\") pod \"model-serving-api-5dd488fc48-x77f5\" (UID: \"61354af9-1ed4-4859-8bb1-ba2691b2ad73\") " pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:20.920995 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:20.920972 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92cbf\" (UniqueName: \"kubernetes.io/projected/61354af9-1ed4-4859-8bb1-ba2691b2ad73-kube-api-access-92cbf\") pod \"model-serving-api-5dd488fc48-x77f5\" (UID: \"61354af9-1ed4-4859-8bb1-ba2691b2ad73\") " pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:21.000171 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:21.000138 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:21.151604 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:21.151557 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-x77f5"] Jun 12 18:29:21.154927 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:21.154871 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61354af9_1ed4_4859_8bb1_ba2691b2ad73.slice/crio-22d8eb83c973b3d070018f49cd74adad301a6c2f999cf0a1284405d15e1ed843 WatchSource:0}: Error finding container 22d8eb83c973b3d070018f49cd74adad301a6c2f999cf0a1284405d15e1ed843: Status 404 returned error can't find the container with id 22d8eb83c973b3d070018f49cd74adad301a6c2f999cf0a1284405d15e1ed843 Jun 12 18:29:21.543448 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:21.543397 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" event={"ID":"a7374151-e679-415c-a3dc-cb49a7e4c8c7","Type":"ContainerStarted","Data":"d329116445d70dca649160754503bf2b4d7bbba71072e60dcf032975c23709bb"} Jun 12 18:29:21.545534 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:21.545500 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" event={"ID":"61354af9-1ed4-4859-8bb1-ba2691b2ad73","Type":"ContainerStarted","Data":"22d8eb83c973b3d070018f49cd74adad301a6c2f999cf0a1284405d15e1ed843"} Jun 12 18:29:25.572410 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.572365 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" event={"ID":"a7374151-e679-415c-a3dc-cb49a7e4c8c7","Type":"ContainerStarted","Data":"7a42894ede9d7f388cc4c15a1127487c064bce3758b2045e5f10891005903659"} Jun 12 18:29:25.572878 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.572465 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:25.573799 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.573775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" event={"ID":"80bce672-2bbf-4007-95f2-8d09797003b8","Type":"ContainerStarted","Data":"2831e67db5a8beb1e2507297472f666986fef87ddf778bc07218736a172b7d0d"} Jun 12 18:29:25.575133 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.575094 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" event={"ID":"61354af9-1ed4-4859-8bb1-ba2691b2ad73","Type":"ContainerStarted","Data":"1b37b332f09e2efabf0d31f517dc9e5bc23683cf83390c4ba35589a181502118"} Jun 12 18:29:25.575271 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.575155 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:25.591750 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.591707 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" podStartSLOduration=1.038939172 podStartE2EDuration="5.591692854s" totalImagesPullingTime="4.552753682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:25.591037884 +0000 UTC m=+455.160326316" watchObservedRunningTime="2026-06-12 18:29:25.591692854 +0000 UTC m=+455.160981361" Jun 12 18:29:25.609875 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.609834 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" podStartSLOduration=1.684253806 podStartE2EDuration="5.609821465s" totalImagesPullingTime="3.925567659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:25.608874555 +0000 UTC m=+455.178163009" watchObservedRunningTime="2026-06-12 18:29:25.609821465 +0000 UTC m=+455.179109896" Jun 12 18:29:25.625500 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:25.625435 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-fxsk9" podStartSLOduration=1.884790143 podStartE2EDuration="6.625416119s" totalImagesPullingTime="4.740625976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:25.625111996 +0000 UTC m=+455.194400427" watchObservedRunningTime="2026-06-12 18:29:25.625416119 +0000 UTC m=+455.194704551" Jun 12 18:29:30.576338 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.576299 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qffz5"] Jun 12 18:29:30.578652 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.578633 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.582722 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.582703 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 12 18:29:30.582722 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.582718 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-f9xs9\"" Jun 12 18:29:30.591386 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.591362 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd"] Jun 12 18:29:30.593483 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.593465 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.596022 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.595999 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qffz5"] Jun 12 18:29:30.597196 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.596896 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 12 18:29:30.597342 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.597243 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8vphq\"" Jun 12 18:29:30.609248 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.609179 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd"] Jun 12 18:29:30.705864 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.705833 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76713341-9df1-4f09-9189-11da22647ef0-cert\") pod \"kserve-controller-manager-69fc866d76-qffz5\" (UID: \"76713341-9df1-4f09-9189-11da22647ef0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.706054 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.705877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rxpf\" (UniqueName: \"kubernetes.io/projected/b6d2b577-ef68-48eb-ae98-bac40aba7704-kube-api-access-8rxpf\") pod \"llmisvc-controller-manager-864bfd7bc9-cprsd\" (UID: \"b6d2b577-ef68-48eb-ae98-bac40aba7704\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.706054 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.705897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ct79\" (UniqueName: \"kubernetes.io/projected/76713341-9df1-4f09-9189-11da22647ef0-kube-api-access-5ct79\") pod \"kserve-controller-manager-69fc866d76-qffz5\" (UID: \"76713341-9df1-4f09-9189-11da22647ef0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.706054 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.705960 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6d2b577-ef68-48eb-ae98-bac40aba7704-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cprsd\" (UID: \"b6d2b577-ef68-48eb-ae98-bac40aba7704\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.806655 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.806619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76713341-9df1-4f09-9189-11da22647ef0-cert\") pod \"kserve-controller-manager-69fc866d76-qffz5\" (UID: \"76713341-9df1-4f09-9189-11da22647ef0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.806850 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.806667 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rxpf\" (UniqueName: \"kubernetes.io/projected/b6d2b577-ef68-48eb-ae98-bac40aba7704-kube-api-access-8rxpf\") pod \"llmisvc-controller-manager-864bfd7bc9-cprsd\" (UID: \"b6d2b577-ef68-48eb-ae98-bac40aba7704\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.806850 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.806685 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ct79\" (UniqueName: \"kubernetes.io/projected/76713341-9df1-4f09-9189-11da22647ef0-kube-api-access-5ct79\") pod \"kserve-controller-manager-69fc866d76-qffz5\" (UID: \"76713341-9df1-4f09-9189-11da22647ef0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.806850 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.806804 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6d2b577-ef68-48eb-ae98-bac40aba7704-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cprsd\" (UID: \"b6d2b577-ef68-48eb-ae98-bac40aba7704\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.809166 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.809144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76713341-9df1-4f09-9189-11da22647ef0-cert\") pod \"kserve-controller-manager-69fc866d76-qffz5\" (UID: \"76713341-9df1-4f09-9189-11da22647ef0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.809269 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.809198 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6d2b577-ef68-48eb-ae98-bac40aba7704-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cprsd\" (UID: \"b6d2b577-ef68-48eb-ae98-bac40aba7704\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.823514 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.823483 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rxpf\" (UniqueName: \"kubernetes.io/projected/b6d2b577-ef68-48eb-ae98-bac40aba7704-kube-api-access-8rxpf\") pod \"llmisvc-controller-manager-864bfd7bc9-cprsd\" (UID: \"b6d2b577-ef68-48eb-ae98-bac40aba7704\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:30.829146 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.829086 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ct79\" (UniqueName: \"kubernetes.io/projected/76713341-9df1-4f09-9189-11da22647ef0-kube-api-access-5ct79\") pod \"kserve-controller-manager-69fc866d76-qffz5\" (UID: \"76713341-9df1-4f09-9189-11da22647ef0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.888791 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.888753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:30.904730 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:30.904701 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:31.055401 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:31.055370 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-qffz5"] Jun 12 18:29:31.058245 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:31.058220 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76713341_9df1_4f09_9189_11da22647ef0.slice/crio-facf0fc58b752639851e8470b00f1881e957f9a1e9cd76464956d3079d88e56e WatchSource:0}: Error finding container facf0fc58b752639851e8470b00f1881e957f9a1e9cd76464956d3079d88e56e: Status 404 returned error can't find the container with id facf0fc58b752639851e8470b00f1881e957f9a1e9cd76464956d3079d88e56e Jun 12 18:29:31.084595 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:31.084513 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd"] Jun 12 18:29:31.087482 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:31.087455 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6d2b577_ef68_48eb_ae98_bac40aba7704.slice/crio-e52fc8ac459b0e90178cb45b63d44c93e07ea33833e81dce3ea137250a8ad642 WatchSource:0}: Error finding container e52fc8ac459b0e90178cb45b63d44c93e07ea33833e81dce3ea137250a8ad642: Status 404 returned error can't find the container with id e52fc8ac459b0e90178cb45b63d44c93e07ea33833e81dce3ea137250a8ad642 Jun 12 18:29:31.607384 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:31.607350 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" event={"ID":"76713341-9df1-4f09-9189-11da22647ef0","Type":"ContainerStarted","Data":"facf0fc58b752639851e8470b00f1881e957f9a1e9cd76464956d3079d88e56e"} Jun 12 18:29:31.608637 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:31.608608 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" event={"ID":"b6d2b577-ef68-48eb-ae98-bac40aba7704","Type":"ContainerStarted","Data":"e52fc8ac459b0e90178cb45b63d44c93e07ea33833e81dce3ea137250a8ad642"} Jun 12 18:29:34.626860 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:34.626817 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" event={"ID":"76713341-9df1-4f09-9189-11da22647ef0","Type":"ContainerStarted","Data":"11b0df9a4c390cddf06edb5fcde60cac4a166a0fa7371575476a37415e92c1b9"} Jun 12 18:29:34.627306 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:34.626921 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:29:34.663310 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:34.663247 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" podStartSLOduration=1.8092721470000002 podStartE2EDuration="4.663230066s" totalImagesPullingTime="2.853957919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:34.661809893 +0000 UTC m=+464.231098361" watchObservedRunningTime="2026-06-12 18:29:34.663230066 +0000 UTC m=+464.232518496" Jun 12 18:29:35.633197 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:35.633161 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" event={"ID":"b6d2b577-ef68-48eb-ae98-bac40aba7704","Type":"ContainerStarted","Data":"e5e03a9330d464f5baf1e0c4ac087d0d0ba20c1ebc0ed25e96386ee07540faa8"} Jun 12 18:29:35.633601 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:35.633437 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:29:35.813120 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:35.813065 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" podStartSLOduration=2.151466246 podStartE2EDuration="5.813048318s" totalImagesPullingTime="3.661582072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:35.804614557 +0000 UTC m=+465.373902988" watchObservedRunningTime="2026-06-12 18:29:35.813048318 +0000 UTC m=+465.382336749" Jun 12 18:29:36.581627 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:36.581569 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-shcqs" Jun 12 18:29:36.584420 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:36.584385 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-x77f5" Jun 12 18:29:37.925969 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:37.925934 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w"] Jun 12 18:29:37.929141 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:37.929123 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:37.932004 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:37.931976 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 12 18:29:37.932125 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:37.932035 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-bhdzt\"" Jun 12 18:29:37.932180 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:37.932167 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 12 18:29:37.948003 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:37.947963 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w"] Jun 12 18:29:38.078117 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.078072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6e41f24b-53b7-4efa-ac34-2a42f62a0923-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dsp4w\" (UID: \"6e41f24b-53b7-4efa-ac34-2a42f62a0923\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.078316 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.078204 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6zvh\" (UniqueName: \"kubernetes.io/projected/6e41f24b-53b7-4efa-ac34-2a42f62a0923-kube-api-access-t6zvh\") pod \"servicemesh-operator3-57f65f65fb-dsp4w\" (UID: \"6e41f24b-53b7-4efa-ac34-2a42f62a0923\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.179189 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.179107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6e41f24b-53b7-4efa-ac34-2a42f62a0923-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dsp4w\" (UID: \"6e41f24b-53b7-4efa-ac34-2a42f62a0923\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.179189 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.179162 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6zvh\" (UniqueName: \"kubernetes.io/projected/6e41f24b-53b7-4efa-ac34-2a42f62a0923-kube-api-access-t6zvh\") pod \"servicemesh-operator3-57f65f65fb-dsp4w\" (UID: \"6e41f24b-53b7-4efa-ac34-2a42f62a0923\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.181638 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.181616 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6e41f24b-53b7-4efa-ac34-2a42f62a0923-operator-config\") pod \"servicemesh-operator3-57f65f65fb-dsp4w\" (UID: \"6e41f24b-53b7-4efa-ac34-2a42f62a0923\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.188616 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.188567 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6zvh\" (UniqueName: \"kubernetes.io/projected/6e41f24b-53b7-4efa-ac34-2a42f62a0923-kube-api-access-t6zvh\") pod \"servicemesh-operator3-57f65f65fb-dsp4w\" (UID: \"6e41f24b-53b7-4efa-ac34-2a42f62a0923\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.237553 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.237516 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:38.393877 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.393852 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w"] Jun 12 18:29:38.395451 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:38.395424 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e41f24b_53b7_4efa_ac34_2a42f62a0923.slice/crio-27ab6ece5a7383945374531114208ef6eca6a4638ed52406376a6499af67a514 WatchSource:0}: Error finding container 27ab6ece5a7383945374531114208ef6eca6a4638ed52406376a6499af67a514: Status 404 returned error can't find the container with id 27ab6ece5a7383945374531114208ef6eca6a4638ed52406376a6499af67a514 Jun 12 18:29:38.649866 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:38.649830 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" event={"ID":"6e41f24b-53b7-4efa-ac34-2a42f62a0923","Type":"ContainerStarted","Data":"27ab6ece5a7383945374531114208ef6eca6a4638ed52406376a6499af67a514"} Jun 12 18:29:41.666132 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:41.666094 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" event={"ID":"6e41f24b-53b7-4efa-ac34-2a42f62a0923","Type":"ContainerStarted","Data":"4914fe021ced36c54d3497c1a5e2b1a10b16a16a504c2d3d93fb86dc8a4bf210"} Jun 12 18:29:41.666513 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:41.666153 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:41.689520 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:41.689463 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" podStartSLOduration=1.972260318 podStartE2EDuration="4.689442711s" totalImagesPullingTime="2.717182393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:41.688145597 +0000 UTC m=+471.257434042" watchObservedRunningTime="2026-06-12 18:29:41.689442711 +0000 UTC m=+471.258731143" Jun 12 18:29:49.053352 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.053315 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq"] Jun 12 18:29:49.060382 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.059045 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.062435 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.062408 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 12 18:29:49.062633 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.062593 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 12 18:29:49.062845 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.062678 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j4wfm\"" Jun 12 18:29:49.062962 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.062945 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 12 18:29:49.063655 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.063634 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 18:29:49.074309 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.074286 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq"] Jun 12 18:29:49.175793 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.175986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.175986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.175986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175877 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.175986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.175986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.175986 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.175950 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ng2\" (UniqueName: \"kubernetes.io/projected/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-kube-api-access-54ng2\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277054 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277011 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277258 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277258 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277377 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277271 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277377 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277620 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277455 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.277826 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.277802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ng2\" (UniqueName: \"kubernetes.io/projected/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-kube-api-access-54ng2\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.278082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.278055 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.279610 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.279560 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.279770 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.279749 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.279950 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.279934 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.279994 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.279960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.287734 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.287706 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.287880 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.287864 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ng2\" (UniqueName: \"kubernetes.io/projected/617fbc3e-8dab-4501-889b-ccd77e3fe0b4-kube-api-access-54ng2\") pod \"istiod-openshift-gateway-75c67f8887-qstfq\" (UID: \"617fbc3e-8dab-4501-889b-ccd77e3fe0b4\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.370645 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.370550 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:49.509905 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.509880 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq"] Jun 12 18:29:49.511840 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:29:49.511809 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617fbc3e_8dab_4501_889b_ccd77e3fe0b4.slice/crio-aafb5ce41581e1b919f2f8f96e602ed696002ffcbda847d8175fc9915c6b598d WatchSource:0}: Error finding container aafb5ce41581e1b919f2f8f96e602ed696002ffcbda847d8175fc9915c6b598d: Status 404 returned error can't find the container with id aafb5ce41581e1b919f2f8f96e602ed696002ffcbda847d8175fc9915c6b598d Jun 12 18:29:49.703023 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:49.702938 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" event={"ID":"617fbc3e-8dab-4501-889b-ccd77e3fe0b4","Type":"ContainerStarted","Data":"aafb5ce41581e1b919f2f8f96e602ed696002ffcbda847d8175fc9915c6b598d"} Jun 12 18:29:51.944340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:51.940650 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 18:29:51.944340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:51.940791 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 12 18:29:52.672785 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:52.672748 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-dsp4w" Jun 12 18:29:52.719609 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:52.719558 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" event={"ID":"617fbc3e-8dab-4501-889b-ccd77e3fe0b4","Type":"ContainerStarted","Data":"6009a7987efcf02a4b743e096f03398cf520d8dd115baa16a72be49d7ea53a74"} Jun 12 18:29:52.719775 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:52.719678 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:52.767078 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:52.767024 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" podStartSLOduration=1.340703355 podStartE2EDuration="3.767005121s" totalImagesPullingTime="2.426301766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:52.764496088 +0000 UTC m=+482.333784520" watchObservedRunningTime="2026-06-12 18:29:52.767005121 +0000 UTC m=+482.336293552" Jun 12 18:29:53.726479 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:53.726447 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-qstfq" Jun 12 18:29:57.746103 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.746074 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-d4785c585-68255"] Jun 12 18:29:57.810357 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.810322 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-d4785c585-68255"] Jun 12 18:29:57.810551 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.810426 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:57.814205 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.814185 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-chxvn\"" Jun 12 18:29:57.815134 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.815120 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 12 18:29:57.852282 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.852250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/25e51ef0-e082-4f46-b419-98bb30325665-redirect-config\") pod \"dashboard-redirect-d4785c585-68255\" (UID: \"25e51ef0-e082-4f46-b419-98bb30325665\") " pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:57.852477 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.852300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbf5m\" (UniqueName: \"kubernetes.io/projected/25e51ef0-e082-4f46-b419-98bb30325665-kube-api-access-mbf5m\") pod \"dashboard-redirect-d4785c585-68255\" (UID: \"25e51ef0-e082-4f46-b419-98bb30325665\") " pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:57.952813 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.952777 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/25e51ef0-e082-4f46-b419-98bb30325665-redirect-config\") pod \"dashboard-redirect-d4785c585-68255\" (UID: \"25e51ef0-e082-4f46-b419-98bb30325665\") " pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:57.952959 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.952819 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbf5m\" (UniqueName: \"kubernetes.io/projected/25e51ef0-e082-4f46-b419-98bb30325665-kube-api-access-mbf5m\") pod \"dashboard-redirect-d4785c585-68255\" (UID: \"25e51ef0-e082-4f46-b419-98bb30325665\") " pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:57.953466 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.953444 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/25e51ef0-e082-4f46-b419-98bb30325665-redirect-config\") pod \"dashboard-redirect-d4785c585-68255\" (UID: \"25e51ef0-e082-4f46-b419-98bb30325665\") " pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:57.962277 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:57.962245 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbf5m\" (UniqueName: \"kubernetes.io/projected/25e51ef0-e082-4f46-b419-98bb30325665-kube-api-access-mbf5m\") pod \"dashboard-redirect-d4785c585-68255\" (UID: \"25e51ef0-e082-4f46-b419-98bb30325665\") " pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:58.120078 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:58.119998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-d4785c585-68255" Jun 12 18:29:58.271307 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:58.271280 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-d4785c585-68255"] Jun 12 18:29:58.747849 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:29:58.747810 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-d4785c585-68255" event={"ID":"25e51ef0-e082-4f46-b419-98bb30325665","Type":"ContainerStarted","Data":"f1656360f771d3462630dd72f4d55769f2463d2e3a6f582422f0c221f7e5886a"} Jun 12 18:30:00.760194 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:30:00.760107 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-d4785c585-68255" event={"ID":"25e51ef0-e082-4f46-b419-98bb30325665","Type":"ContainerStarted","Data":"bea3eafaa37fb1e2ea9ee09bc90efe32ba23a5a4e0102e8c72ce56277e63f595"} Jun 12 18:30:00.778398 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:30:00.778342 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-d4785c585-68255" podStartSLOduration=1.580189881 podStartE2EDuration="3.778325828s" totalImagesPullingTime="2.198135947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:30:00.775675746 +0000 UTC m=+490.344964179" watchObservedRunningTime="2026-06-12 18:30:00.778325828 +0000 UTC m=+490.347614259" Jun 12 18:30:05.638541 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:30:05.638505 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-qffz5" Jun 12 18:30:06.640569 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:30:06.640540 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cprsd" Jun 12 18:31:01.636104 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.636024 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f"] Jun 12 18:31:01.639472 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.639448 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.643111 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.643090 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jwh5r\"" Jun 12 18:31:01.643545 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.643530 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:31:01.643830 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.643815 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:31:01.670904 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.670867 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f"] Jun 12 18:31:01.716247 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.716213 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9xq\" (UniqueName: \"kubernetes.io/projected/f4f31c62-be42-43f4-ad8e-440fb3b87153-kube-api-access-7w9xq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.716436 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.716294 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f31c62-be42-43f4-ad8e-440fb3b87153-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.817633 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.817595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f31c62-be42-43f4-ad8e-440fb3b87153-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.817823 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.817678 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9xq\" (UniqueName: \"kubernetes.io/projected/f4f31c62-be42-43f4-ad8e-440fb3b87153-kube-api-access-7w9xq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.817969 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.817946 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f31c62-be42-43f4-ad8e-440fb3b87153-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.825933 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.825911 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9xq\" (UniqueName: \"kubernetes.io/projected/f4f31c62-be42-43f4-ad8e-440fb3b87153-kube-api-access-7w9xq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:01.949440 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:01.949365 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:02.095683 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:02.095531 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f"] Jun 12 18:31:02.098656 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:31:02.098624 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f31c62_be42_43f4_ad8e_440fb3b87153.slice/crio-af517047eec0c90d5f2aaf97e0c915252ec1dd94fbdcef76ea382fef94938610 WatchSource:0}: Error finding container af517047eec0c90d5f2aaf97e0c915252ec1dd94fbdcef76ea382fef94938610: Status 404 returned error can't find the container with id af517047eec0c90d5f2aaf97e0c915252ec1dd94fbdcef76ea382fef94938610 Jun 12 18:31:03.040836 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:03.040803 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" event={"ID":"f4f31c62-be42-43f4-ad8e-440fb3b87153","Type":"ContainerStarted","Data":"af517047eec0c90d5f2aaf97e0c915252ec1dd94fbdcef76ea382fef94938610"} Jun 12 18:31:10.075366 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:10.075282 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" event={"ID":"f4f31c62-be42-43f4-ad8e-440fb3b87153","Type":"ContainerStarted","Data":"cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0"} Jun 12 18:31:10.075366 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:10.075358 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:10.102330 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:10.102278 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" podStartSLOduration=1.43360786 podStartE2EDuration="9.102262987s" totalImagesPullingTime="7.668655127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:10.1019575 +0000 UTC m=+559.671245976" watchObservedRunningTime="2026-06-12 18:31:10.102262987 +0000 UTC m=+559.671551418" Jun 12 18:31:21.082544 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:21.082510 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:22.844221 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.844188 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f"] Jun 12 18:31:22.844643 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.844467 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" podUID="f4f31c62-be42-43f4-ad8e-440fb3b87153" containerName="manager" containerID="cri-o://cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0" gracePeriod=2 Jun 12 18:31:22.866838 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.866805 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f"] Jun 12 18:31:22.886952 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:31:22.886910 2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"f4f31c62-be42-43f4-ad8e-440fb3b87153\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\": pods \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:22.893882 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.893852 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r"] Jun 12 18:31:22.894591 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.894554 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f31c62-be42-43f4-ad8e-440fb3b87153" containerName="manager" Jun 12 18:31:22.894591 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.894594 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f31c62-be42-43f4-ad8e-440fb3b87153" containerName="manager" Jun 12 18:31:22.894751 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.894690 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f31c62-be42-43f4-ad8e-440fb3b87153" containerName="manager" Jun 12 18:31:22.897758 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.897734 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:22.909559 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.909524 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6def2d-e06c-4228-99f1-9062ee2316e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ms95r\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:22.909705 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.909597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q8wj\" (UniqueName: \"kubernetes.io/projected/aa6def2d-e06c-4228-99f1-9062ee2316e9-kube-api-access-9q8wj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ms95r\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:22.942155 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:22.942123 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r"] Jun 12 18:31:22.968418 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:31:22.968367 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wjb5f\" is forbidden: User \"system:node:ip-10-0-135-194.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-194.ec2.internal' and this object" podUID="f4f31c62-be42-43f4-ad8e-440fb3b87153" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:23.010886 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.010847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6def2d-e06c-4228-99f1-9062ee2316e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ms95r\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:23.011067 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.010893 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q8wj\" (UniqueName: \"kubernetes.io/projected/aa6def2d-e06c-4228-99f1-9062ee2316e9-kube-api-access-9q8wj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ms95r\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:23.011244 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.011223 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6def2d-e06c-4228-99f1-9062ee2316e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ms95r\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:23.019207 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.019174 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q8wj\" (UniqueName: \"kubernetes.io/projected/aa6def2d-e06c-4228-99f1-9062ee2316e9-kube-api-access-9q8wj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ms95r\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:23.084616 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.084569 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:23.111822 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.111744 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w9xq\" (UniqueName: \"kubernetes.io/projected/f4f31c62-be42-43f4-ad8e-440fb3b87153-kube-api-access-7w9xq\") pod \"f4f31c62-be42-43f4-ad8e-440fb3b87153\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " Jun 12 18:31:23.111946 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.111831 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f31c62-be42-43f4-ad8e-440fb3b87153-extensions-socket-volume\") pod \"f4f31c62-be42-43f4-ad8e-440fb3b87153\" (UID: \"f4f31c62-be42-43f4-ad8e-440fb3b87153\") " Jun 12 18:31:23.112289 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.112263 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f31c62-be42-43f4-ad8e-440fb3b87153-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4f31c62-be42-43f4-ad8e-440fb3b87153" (UID: "f4f31c62-be42-43f4-ad8e-440fb3b87153"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:31:23.114022 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.113994 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f31c62-be42-43f4-ad8e-440fb3b87153-kube-api-access-7w9xq" (OuterVolumeSpecName: "kube-api-access-7w9xq") pod "f4f31c62-be42-43f4-ad8e-440fb3b87153" (UID: "f4f31c62-be42-43f4-ad8e-440fb3b87153"). InnerVolumeSpecName "kube-api-access-7w9xq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:31:23.135213 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.135189 2557 generic.go:356] "Generic (PLEG): container finished" podID="f4f31c62-be42-43f4-ad8e-440fb3b87153" containerID="cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0" exitCode=0 Jun 12 18:31:23.135332 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.135228 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wjb5f" Jun 12 18:31:23.135332 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.135297 2557 scope.go:117] "RemoveContainer" containerID="cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0" Jun 12 18:31:23.144254 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.144237 2557 scope.go:117] "RemoveContainer" containerID="cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0" Jun 12 18:31:23.144565 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:31:23.144545 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0\": container with ID starting with cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0 not found: ID does not exist" containerID="cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0" Jun 12 18:31:23.144659 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.144597 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0"} err="failed to get container status \"cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0\": rpc error: code = NotFound desc = could not find container \"cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0\": container with ID starting with cc3db14157584057196fb9cc96676195a6788aae2740c67ea40e462357e211e0 not found: ID does not exist" Jun 12 18:31:23.213402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.213371 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w9xq\" (UniqueName: \"kubernetes.io/projected/f4f31c62-be42-43f4-ad8e-440fb3b87153-kube-api-access-7w9xq\") on node \"ip-10-0-135-194.ec2.internal\" DevicePath \"\"" Jun 12 18:31:23.213402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.213398 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4f31c62-be42-43f4-ad8e-440fb3b87153-extensions-socket-volume\") on node \"ip-10-0-135-194.ec2.internal\" DevicePath \"\"" Jun 12 18:31:23.222868 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.222845 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:23.365994 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:23.365859 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r"] Jun 12 18:31:23.368917 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:31:23.368894 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6def2d_e06c_4228_99f1_9062ee2316e9.slice/crio-8485ad8831de3e37ea50ee5278c024ed8b0fd423fd8dba3777d2491febb39bbd WatchSource:0}: Error finding container 8485ad8831de3e37ea50ee5278c024ed8b0fd423fd8dba3777d2491febb39bbd: Status 404 returned error can't find the container with id 8485ad8831de3e37ea50ee5278c024ed8b0fd423fd8dba3777d2491febb39bbd Jun 12 18:31:24.142536 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:24.142498 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" event={"ID":"aa6def2d-e06c-4228-99f1-9062ee2316e9","Type":"ContainerStarted","Data":"a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110"} Jun 12 18:31:24.142951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:24.142548 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" event={"ID":"aa6def2d-e06c-4228-99f1-9062ee2316e9","Type":"ContainerStarted","Data":"8485ad8831de3e37ea50ee5278c024ed8b0fd423fd8dba3777d2491febb39bbd"} Jun 12 18:31:24.142951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:24.142628 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:24.169596 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:24.169533 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" podStartSLOduration=2.169518725 podStartE2EDuration="2.169518725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:24.166951511 +0000 UTC m=+573.736239963" watchObservedRunningTime="2026-06-12 18:31:24.169518725 +0000 UTC m=+573.738807157" Jun 12 18:31:24.917896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:24.917866 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f31c62-be42-43f4-ad8e-440fb3b87153" path="/var/lib/kubelet/pods/f4f31c62-be42-43f4-ad8e-440fb3b87153/volumes" Jun 12 18:31:35.149759 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:35.149724 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:50.892599 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:50.892560 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:31:50.893138 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:50.893123 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:31:53.269850 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.269802 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r"] Jun 12 18:31:53.270278 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.270048 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" podUID="aa6def2d-e06c-4228-99f1-9062ee2316e9" containerName="manager" containerID="cri-o://a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110" gracePeriod=10 Jun 12 18:31:53.470808 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.470777 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f"] Jun 12 18:31:53.474046 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.474031 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.485541 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.485514 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f"] Jun 12 18:31:53.522428 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.522364 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:53.596543 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.596496 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjq8v\" (UniqueName: \"kubernetes.io/projected/2e4de100-3731-4b9f-a9bf-a4f0b00acfe0-kube-api-access-hjq8v\") pod \"kuadrant-operator-controller-manager-86878c769f-qpr9f\" (UID: \"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.596543 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.596546 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4de100-3731-4b9f-a9bf-a4f0b00acfe0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qpr9f\" (UID: \"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.697704 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.697672 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q8wj\" (UniqueName: \"kubernetes.io/projected/aa6def2d-e06c-4228-99f1-9062ee2316e9-kube-api-access-9q8wj\") pod \"aa6def2d-e06c-4228-99f1-9062ee2316e9\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " Jun 12 18:31:53.697877 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.697724 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6def2d-e06c-4228-99f1-9062ee2316e9-extensions-socket-volume\") pod \"aa6def2d-e06c-4228-99f1-9062ee2316e9\" (UID: \"aa6def2d-e06c-4228-99f1-9062ee2316e9\") " Jun 12 18:31:53.697944 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.697897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjq8v\" (UniqueName: \"kubernetes.io/projected/2e4de100-3731-4b9f-a9bf-a4f0b00acfe0-kube-api-access-hjq8v\") pod \"kuadrant-operator-controller-manager-86878c769f-qpr9f\" (UID: \"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.697944 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.697924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4de100-3731-4b9f-a9bf-a4f0b00acfe0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qpr9f\" (UID: \"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.698189 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.698162 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa6def2d-e06c-4228-99f1-9062ee2316e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa6def2d-e06c-4228-99f1-9062ee2316e9" (UID: "aa6def2d-e06c-4228-99f1-9062ee2316e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:31:53.698306 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.698282 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2e4de100-3731-4b9f-a9bf-a4f0b00acfe0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qpr9f\" (UID: \"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.699897 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.699871 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6def2d-e06c-4228-99f1-9062ee2316e9-kube-api-access-9q8wj" (OuterVolumeSpecName: "kube-api-access-9q8wj") pod "aa6def2d-e06c-4228-99f1-9062ee2316e9" (UID: "aa6def2d-e06c-4228-99f1-9062ee2316e9"). InnerVolumeSpecName "kube-api-access-9q8wj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:31:53.706688 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.706663 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjq8v\" (UniqueName: \"kubernetes.io/projected/2e4de100-3731-4b9f-a9bf-a4f0b00acfe0-kube-api-access-hjq8v\") pod \"kuadrant-operator-controller-manager-86878c769f-qpr9f\" (UID: \"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.784459 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.784358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:53.798843 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.798818 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q8wj\" (UniqueName: \"kubernetes.io/projected/aa6def2d-e06c-4228-99f1-9062ee2316e9-kube-api-access-9q8wj\") on node \"ip-10-0-135-194.ec2.internal\" DevicePath \"\"" Jun 12 18:31:53.798843 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.798844 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa6def2d-e06c-4228-99f1-9062ee2316e9-extensions-socket-volume\") on node \"ip-10-0-135-194.ec2.internal\" DevicePath \"\"" Jun 12 18:31:53.938402 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:53.927439 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f"] Jun 12 18:31:53.938402 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:31:53.929818 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4de100_3731_4b9f_a9bf_a4f0b00acfe0.slice/crio-b57f0154f61ca2d8bab789941b383f84ddfde8630c1fd430110eb7bb6b9c6547 WatchSource:0}: Error finding container b57f0154f61ca2d8bab789941b383f84ddfde8630c1fd430110eb7bb6b9c6547: Status 404 returned error can't find the container with id b57f0154f61ca2d8bab789941b383f84ddfde8630c1fd430110eb7bb6b9c6547 Jun 12 18:31:54.288747 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.288715 2557 generic.go:356] "Generic (PLEG): container finished" podID="aa6def2d-e06c-4228-99f1-9062ee2316e9" containerID="a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110" exitCode=0 Jun 12 18:31:54.289194 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.288761 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" Jun 12 18:31:54.289194 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.288802 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" event={"ID":"aa6def2d-e06c-4228-99f1-9062ee2316e9","Type":"ContainerDied","Data":"a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110"} Jun 12 18:31:54.289194 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.288858 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r" event={"ID":"aa6def2d-e06c-4228-99f1-9062ee2316e9","Type":"ContainerDied","Data":"8485ad8831de3e37ea50ee5278c024ed8b0fd423fd8dba3777d2491febb39bbd"} Jun 12 18:31:54.289194 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.288887 2557 scope.go:117] "RemoveContainer" containerID="a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110" Jun 12 18:31:54.294818 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.294651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" event={"ID":"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0","Type":"ContainerStarted","Data":"a9a9459312544406447329273a1d021bb896c978fe57d8a60f8ddd3b54ef611a"} Jun 12 18:31:54.294818 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.294707 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" event={"ID":"2e4de100-3731-4b9f-a9bf-a4f0b00acfe0","Type":"ContainerStarted","Data":"b57f0154f61ca2d8bab789941b383f84ddfde8630c1fd430110eb7bb6b9c6547"} Jun 12 18:31:54.294954 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.294823 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:31:54.301667 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.301645 2557 scope.go:117] "RemoveContainer" containerID="a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110" Jun 12 18:31:54.301952 ip-10-0-135-194 kubenswrapper[2557]: E0612 18:31:54.301936 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110\": container with ID starting with a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110 not found: ID does not exist" containerID="a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110" Jun 12 18:31:54.302017 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.301964 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110"} err="failed to get container status \"a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110\": rpc error: code = NotFound desc = could not find container \"a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110\": container with ID starting with a2634962d6bcbf1ff4b1be6b06331a5cb8c3fc017c3cc48c4e29ae4a2cf57110 not found: ID does not exist" Jun 12 18:31:54.320057 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.320009 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" podStartSLOduration=1.319992925 podStartE2EDuration="1.319992925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:54.318036466 +0000 UTC m=+603.887324924" watchObservedRunningTime="2026-06-12 18:31:54.319992925 +0000 UTC m=+603.889281406" Jun 12 18:31:54.341270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.341236 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r"] Jun 12 18:31:54.345379 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.345353 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ms95r"] Jun 12 18:31:54.917251 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:31:54.917217 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6def2d-e06c-4228-99f1-9062ee2316e9" path="/var/lib/kubelet/pods/aa6def2d-e06c-4228-99f1-9062ee2316e9/volumes" Jun 12 18:32:05.303243 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:05.303211 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qpr9f" Jun 12 18:32:14.341307 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.341219 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:32:14.341856 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.341631 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6def2d-e06c-4228-99f1-9062ee2316e9" containerName="manager" Jun 12 18:32:14.341856 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.341644 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6def2d-e06c-4228-99f1-9062ee2316e9" containerName="manager" Jun 12 18:32:14.341856 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.341818 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6def2d-e06c-4228-99f1-9062ee2316e9" containerName="manager" Jun 12 18:32:14.344767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.344746 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.347428 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.347404 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 18:32:14.347555 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.347466 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zvbn7\"" Jun 12 18:32:14.353410 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.353320 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:32:14.384857 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.384822 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:32:14.477856 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.477822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4b9z\" (UniqueName: \"kubernetes.io/projected/8f004e0d-d690-4949-b9c6-a5e09f667196-kube-api-access-w4b9z\") pod \"limitador-limitador-54d6d988d5-2pptp\" (UID: \"8f004e0d-d690-4949-b9c6-a5e09f667196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.478042 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.477876 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f004e0d-d690-4949-b9c6-a5e09f667196-config-file\") pod \"limitador-limitador-54d6d988d5-2pptp\" (UID: \"8f004e0d-d690-4949-b9c6-a5e09f667196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.578897 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.578856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4b9z\" (UniqueName: \"kubernetes.io/projected/8f004e0d-d690-4949-b9c6-a5e09f667196-kube-api-access-w4b9z\") pod \"limitador-limitador-54d6d988d5-2pptp\" (UID: \"8f004e0d-d690-4949-b9c6-a5e09f667196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.579070 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.578909 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f004e0d-d690-4949-b9c6-a5e09f667196-config-file\") pod \"limitador-limitador-54d6d988d5-2pptp\" (UID: \"8f004e0d-d690-4949-b9c6-a5e09f667196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.579514 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.579496 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8f004e0d-d690-4949-b9c6-a5e09f667196-config-file\") pod \"limitador-limitador-54d6d988d5-2pptp\" (UID: \"8f004e0d-d690-4949-b9c6-a5e09f667196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.587133 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.587106 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4b9z\" (UniqueName: \"kubernetes.io/projected/8f004e0d-d690-4949-b9c6-a5e09f667196-kube-api-access-w4b9z\") pod \"limitador-limitador-54d6d988d5-2pptp\" (UID: \"8f004e0d-d690-4949-b9c6-a5e09f667196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.656721 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.656623 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:14.794481 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.794452 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:32:14.796669 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:32:14.796641 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f004e0d_d690_4949_b9c6_a5e09f667196.slice/crio-adc678470ec6168cfc3096f9f41fe9994adb38a1f3ced482efa8865c252f8ee1 WatchSource:0}: Error finding container adc678470ec6168cfc3096f9f41fe9994adb38a1f3ced482efa8865c252f8ee1: Status 404 returned error can't find the container with id adc678470ec6168cfc3096f9f41fe9994adb38a1f3ced482efa8865c252f8ee1 Jun 12 18:32:14.798522 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:14.798504 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:32:15.397563 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:15.397525 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" event={"ID":"8f004e0d-d690-4949-b9c6-a5e09f667196","Type":"ContainerStarted","Data":"adc678470ec6168cfc3096f9f41fe9994adb38a1f3ced482efa8865c252f8ee1"} Jun 12 18:32:18.412712 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:18.412672 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" event={"ID":"8f004e0d-d690-4949-b9c6-a5e09f667196","Type":"ContainerStarted","Data":"2bde5a674b9bb381bb0eb1728570e2b9c7431529dc963c006915250e36a3df5c"} Jun 12 18:32:18.413100 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:18.412753 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:32:18.432449 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:18.432346 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" podStartSLOduration=1.049525356 podStartE2EDuration="4.432326689s" totalImagesPullingTime="3.382801333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:18.431163219 +0000 UTC m=+628.000451663" watchObservedRunningTime="2026-06-12 18:32:18.432326689 +0000 UTC m=+628.001615129" Jun 12 18:32:29.418367 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:32:29.418332 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2pptp" Jun 12 18:34:21.251571 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.251526 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:34:21.324196 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.324163 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-j598z"] Jun 12 18:34:21.327558 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.327541 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:34:21.334975 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.334954 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 12 18:34:21.335125 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.334979 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-lmxgt\"" Jun 12 18:34:21.341263 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.341237 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-j598z"] Jun 12 18:34:21.421389 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.421348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mcnx\" (UniqueName: \"kubernetes.io/projected/ea88d05b-29fb-4c3e-a0b2-39ee99fd1781-kube-api-access-9mcnx\") pod \"payload-pre-processing-579785bc64-j598z\" (UID: \"ea88d05b-29fb-4c3e-a0b2-39ee99fd1781\") " pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:34:21.522811 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.522719 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mcnx\" (UniqueName: \"kubernetes.io/projected/ea88d05b-29fb-4c3e-a0b2-39ee99fd1781-kube-api-access-9mcnx\") pod \"payload-pre-processing-579785bc64-j598z\" (UID: \"ea88d05b-29fb-4c3e-a0b2-39ee99fd1781\") " pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:34:21.533047 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.533018 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mcnx\" (UniqueName: \"kubernetes.io/projected/ea88d05b-29fb-4c3e-a0b2-39ee99fd1781-kube-api-access-9mcnx\") pod \"payload-pre-processing-579785bc64-j598z\" (UID: \"ea88d05b-29fb-4c3e-a0b2-39ee99fd1781\") " pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:34:21.637858 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.637816 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:34:21.771968 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.771942 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-j598z"] Jun 12 18:34:21.774983 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:34:21.774920 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea88d05b_29fb_4c3e_a0b2_39ee99fd1781.slice/crio-dfaa7dc6ae8885026cc47437d72c772c3339b5af17b3b8ec1f3a9f9c429e57ac WatchSource:0}: Error finding container dfaa7dc6ae8885026cc47437d72c772c3339b5af17b3b8ec1f3a9f9c429e57ac: Status 404 returned error can't find the container with id dfaa7dc6ae8885026cc47437d72c772c3339b5af17b3b8ec1f3a9f9c429e57ac Jun 12 18:34:21.995884 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:21.995853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" event={"ID":"ea88d05b-29fb-4c3e-a0b2-39ee99fd1781","Type":"ContainerStarted","Data":"dfaa7dc6ae8885026cc47437d72c772c3339b5af17b3b8ec1f3a9f9c429e57ac"} Jun 12 18:34:25.012703 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:25.012665 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" event={"ID":"ea88d05b-29fb-4c3e-a0b2-39ee99fd1781","Type":"ContainerStarted","Data":"0f967ea3c6e262113cbc2e49de8dc0cb193e6b6381023a60a4168d850bc710b4"} Jun 12 18:34:25.013078 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:25.012797 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:34:25.030081 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:25.030034 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" podStartSLOduration=1.387906278 podStartE2EDuration="4.030020124s" totalImagesPullingTime="2.642113846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:34:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:34:25.028204358 +0000 UTC m=+754.597492793" watchObservedRunningTime="2026-06-12 18:34:25.030020124 +0000 UTC m=+754.599308556" Jun 12 18:34:36.019803 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:36.019760 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" podUID="ea88d05b-29fb-4c3e-a0b2-39ee99fd1781" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.31:9004: connect: connection refused" Jun 12 18:34:46.018472 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:34:46.018440 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-j598z" Jun 12 18:35:49.109931 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.109888 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd"] Jun 12 18:35:49.113619 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.113593 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.116739 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.116716 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 12 18:35:49.116857 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.116762 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 18:35:49.117755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.117734 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 18:35:49.117897 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.117810 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wxkld\"" Jun 12 18:35:49.165922 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.165893 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd"] Jun 12 18:35:49.293740 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.293696 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.293740 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.293742 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.293969 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.293764 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm59k\" (UniqueName: \"kubernetes.io/projected/883052c7-7f44-48b4-8ebb-3ecf9a020177-kube-api-access-bm59k\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.293969 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.293836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883052c7-7f44-48b4-8ebb-3ecf9a020177-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.293969 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.293866 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.294110 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.293998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.394767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.394678 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.394767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.394716 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.394767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.394736 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm59k\" (UniqueName: \"kubernetes.io/projected/883052c7-7f44-48b4-8ebb-3ecf9a020177-kube-api-access-bm59k\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.394767 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.394763 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883052c7-7f44-48b4-8ebb-3ecf9a020177-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.395082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.394787 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.395082 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.394864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.395190 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.395112 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.395190 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.395161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.395276 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.395241 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.397131 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.397103 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/883052c7-7f44-48b4-8ebb-3ecf9a020177-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.397367 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.397347 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/883052c7-7f44-48b4-8ebb-3ecf9a020177-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.404084 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.404058 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm59k\" (UniqueName: \"kubernetes.io/projected/883052c7-7f44-48b4-8ebb-3ecf9a020177-kube-api-access-bm59k\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd\" (UID: \"883052c7-7f44-48b4-8ebb-3ecf9a020177\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.424533 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.424505 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:49.564557 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.564531 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd"] Jun 12 18:35:49.566693 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:35:49.566655 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883052c7_7f44_48b4_8ebb_3ecf9a020177.slice/crio-3bea92108e79a04febd94b1794360e1a30b5a6ca5044e807c14cb60dfc8760ad WatchSource:0}: Error finding container 3bea92108e79a04febd94b1794360e1a30b5a6ca5044e807c14cb60dfc8760ad: Status 404 returned error can't find the container with id 3bea92108e79a04febd94b1794360e1a30b5a6ca5044e807c14cb60dfc8760ad Jun 12 18:35:49.622226 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:49.622194 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:35:50.424022 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:50.423988 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" event={"ID":"883052c7-7f44-48b4-8ebb-3ecf9a020177","Type":"ContainerStarted","Data":"3bea92108e79a04febd94b1794360e1a30b5a6ca5044e807c14cb60dfc8760ad"} Jun 12 18:35:54.446109 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:54.446060 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" event={"ID":"883052c7-7f44-48b4-8ebb-3ecf9a020177","Type":"ContainerStarted","Data":"6c6d66bb65c319611a46a0527633237c0d9d43ba1e11603e38801fb9b7e6693d"} Jun 12 18:35:55.452889 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:55.452853 2557 generic.go:356] "Generic (PLEG): container finished" podID="883052c7-7f44-48b4-8ebb-3ecf9a020177" containerID="6c6d66bb65c319611a46a0527633237c0d9d43ba1e11603e38801fb9b7e6693d" exitCode=0 Jun 12 18:35:55.453285 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:55.452908 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" event={"ID":"883052c7-7f44-48b4-8ebb-3ecf9a020177","Type":"ContainerDied","Data":"6c6d66bb65c319611a46a0527633237c0d9d43ba1e11603e38801fb9b7e6693d"} Jun 12 18:35:57.467068 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:57.467034 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" event={"ID":"883052c7-7f44-48b4-8ebb-3ecf9a020177","Type":"ContainerStarted","Data":"4e8b8c6aa221417edc423f975528f7c245daa88be2ad32ec5c03e99aabea7099"} Jun 12 18:35:57.490118 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:57.490064 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" podStartSLOduration=1.6513003689999999 podStartE2EDuration="8.490050322s" totalImagesPullingTime="5.409230007s" totalInitContainerRuntime="1.429519946s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:35:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:35:57.487758288 +0000 UTC m=+847.057046719" watchObservedRunningTime="2026-06-12 18:35:57.490050322 +0000 UTC m=+847.059338752" Jun 12 18:35:59.425347 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:59.425312 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:59.425703 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:59.425370 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:59.437714 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:59.437685 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:35:59.486940 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:35:59.486908 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd" Jun 12 18:36:07.715529 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.715495 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb"] Jun 12 18:36:07.722703 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.722678 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.725632 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.725611 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 18:36:07.733182 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.733162 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb"] Jun 12 18:36:07.766784 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.766752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.766970 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.766794 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48f24848-7c53-4c1c-b873-181bad7917fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.766970 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.766836 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.766970 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.766929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfqck\" (UniqueName: \"kubernetes.io/projected/48f24848-7c53-4c1c-b873-181bad7917fe-kube-api-access-vfqck\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.767126 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.766977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.767126 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.767046 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868369 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868325 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868521 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868398 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48f24848-7c53-4c1c-b873-181bad7917fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868521 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868435 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868521 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfqck\" (UniqueName: \"kubernetes.io/projected/48f24848-7c53-4c1c-b873-181bad7917fe-kube-api-access-vfqck\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868734 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868524 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868734 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868911 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868887 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868985 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868938 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.868985 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.868971 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.870566 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.870539 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/48f24848-7c53-4c1c-b873-181bad7917fe-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.870829 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.870811 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/48f24848-7c53-4c1c-b873-181bad7917fe-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:07.877839 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:07.877817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfqck\" (UniqueName: \"kubernetes.io/projected/48f24848-7c53-4c1c-b873-181bad7917fe-kube-api-access-vfqck\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-n6nvb\" (UID: \"48f24848-7c53-4c1c-b873-181bad7917fe\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:08.033997 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:08.033907 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:36:08.175896 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:08.175867 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb"] Jun 12 18:36:08.180717 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:36:08.180689 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f24848_7c53_4c1c_b873_181bad7917fe.slice/crio-30c89d6c9495e85f1761b1c193e1372b36aa973d32d68bca623cca8cf38b639c WatchSource:0}: Error finding container 30c89d6c9495e85f1761b1c193e1372b36aa973d32d68bca623cca8cf38b639c: Status 404 returned error can't find the container with id 30c89d6c9495e85f1761b1c193e1372b36aa973d32d68bca623cca8cf38b639c Jun 12 18:36:08.213696 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:08.213670 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:36:08.525812 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:08.525775 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" event={"ID":"48f24848-7c53-4c1c-b873-181bad7917fe","Type":"ContainerStarted","Data":"75eb145eefc7fa557fe82ff795321139137f081754f011ca5978f204f8096d4f"} Jun 12 18:36:08.525951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:08.525834 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" event={"ID":"48f24848-7c53-4c1c-b873-181bad7917fe","Type":"ContainerStarted","Data":"30c89d6c9495e85f1761b1c193e1372b36aa973d32d68bca623cca8cf38b639c"} Jun 12 18:36:16.408335 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.408304 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd"] Jun 12 18:36:16.412232 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.412210 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.414932 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.414908 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 12 18:36:16.426173 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.426148 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd"] Jun 12 18:36:16.546351 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.546312 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.546351 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.546362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9f95\" (UniqueName: \"kubernetes.io/projected/3f06c86f-6f09-46ea-a963-313601123c04-kube-api-access-c9f95\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.546604 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.546432 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.546604 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.546463 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.546688 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.546606 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f06c86f-6f09-46ea-a963-313601123c04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.546737 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.546690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.647672 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.647624 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.647672 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.647676 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9f95\" (UniqueName: \"kubernetes.io/projected/3f06c86f-6f09-46ea-a963-313601123c04-kube-api-access-c9f95\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.647934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.647738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.647934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.647771 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.647934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.647826 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f06c86f-6f09-46ea-a963-313601123c04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.647934 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.647883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.648166 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.648149 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.648329 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.648307 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.648552 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.648520 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.650316 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.650290 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f06c86f-6f09-46ea-a963-313601123c04-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.650718 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.650697 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f06c86f-6f09-46ea-a963-313601123c04-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.655249 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.655228 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9f95\" (UniqueName: \"kubernetes.io/projected/3f06c86f-6f09-46ea-a963-313601123c04-kube-api-access-c9f95\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd\" (UID: \"3f06c86f-6f09-46ea-a963-313601123c04\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.725284 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.725257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:16.860598 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:16.860555 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd"] Jun 12 18:36:16.862607 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:36:16.862566 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f06c86f_6f09_46ea_a963_313601123c04.slice/crio-105d33d5e1befb7b2b5031f3052e973911f7ccc34c4c7653d8c3d9ada9de8d60 WatchSource:0}: Error finding container 105d33d5e1befb7b2b5031f3052e973911f7ccc34c4c7653d8c3d9ada9de8d60: Status 404 returned error can't find the container with id 105d33d5e1befb7b2b5031f3052e973911f7ccc34c4c7653d8c3d9ada9de8d60 Jun 12 18:36:17.006017 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:17.005930 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:36:17.572008 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:17.571971 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" event={"ID":"3f06c86f-6f09-46ea-a963-313601123c04","Type":"ContainerStarted","Data":"6637e647397c0ea9b1f058e15f8afce8cd872ead40b76abd64271dc835fdc195"} Jun 12 18:36:17.572376 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:17.572024 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" event={"ID":"3f06c86f-6f09-46ea-a963-313601123c04","Type":"ContainerStarted","Data":"105d33d5e1befb7b2b5031f3052e973911f7ccc34c4c7653d8c3d9ada9de8d60"} Jun 12 18:36:18.578383 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:18.578348 2557 generic.go:356] "Generic (PLEG): container finished" podID="3f06c86f-6f09-46ea-a963-313601123c04" containerID="6637e647397c0ea9b1f058e15f8afce8cd872ead40b76abd64271dc835fdc195" exitCode=0 Jun 12 18:36:18.578787 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:18.578434 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" event={"ID":"3f06c86f-6f09-46ea-a963-313601123c04","Type":"ContainerDied","Data":"6637e647397c0ea9b1f058e15f8afce8cd872ead40b76abd64271dc835fdc195"} Jun 12 18:36:19.586392 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:19.586358 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" event={"ID":"3f06c86f-6f09-46ea-a963-313601123c04","Type":"ContainerStarted","Data":"76248b247ea4aaf47099541845abbb549529af301034b044a31146a92a189a8a"} Jun 12 18:36:19.606170 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:19.606120 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" podStartSLOduration=2.064966383 podStartE2EDuration="3.60610231s" totalImagesPullingTime="290.1812ms" totalInitContainerRuntime="1.250954727s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:36:19.605077054 +0000 UTC m=+869.174365486" watchObservedRunningTime="2026-06-12 18:36:19.60610231 +0000 UTC m=+869.175390743" Jun 12 18:36:26.008518 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:26.008481 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:36:26.725400 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:26.725366 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:26.725634 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:26.725442 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:26.738031 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:26.738002 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:27.635852 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:27.635825 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd" Jun 12 18:36:50.923087 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:50.923054 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:36:50.924753 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:50.924733 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gjgsz_2bff06ab-9d88-49d8-8398-cbbf206b2524/ovn-acl-logging/0.log" Jun 12 18:36:55.510488 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:36:55.510455 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:37:04.830199 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:04.830164 2557 generic.go:356] "Generic (PLEG): container finished" podID="48f24848-7c53-4c1c-b873-181bad7917fe" containerID="75eb145eefc7fa557fe82ff795321139137f081754f011ca5978f204f8096d4f" exitCode=0 Jun 12 18:37:04.830741 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:04.830242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" event={"ID":"48f24848-7c53-4c1c-b873-181bad7917fe","Type":"ContainerDied","Data":"75eb145eefc7fa557fe82ff795321139137f081754f011ca5978f204f8096d4f"} Jun 12 18:37:05.836373 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:05.836342 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" event={"ID":"48f24848-7c53-4c1c-b873-181bad7917fe","Type":"ContainerStarted","Data":"a98020f2148efed80b7871a8340c7d4c6561d5a6d038ff2fe5cd368eee890c13"} Jun 12 18:37:05.856724 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:05.856676 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" podStartSLOduration=2.544860186 podStartE2EDuration="58.856659321s" totalImagesPullingTime="210.141382ms" totalInitContainerRuntime="56.101657753s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:05.85560893 +0000 UTC m=+915.424897364" watchObservedRunningTime="2026-06-12 18:37:05.856659321 +0000 UTC m=+915.425947751" Jun 12 18:37:06.807045 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:06.807007 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2pptp"] Jun 12 18:37:08.034911 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:08.034874 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:37:08.035309 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:08.034933 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:37:08.048233 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:08.048203 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:37:08.862681 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:37:08.862652 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-n6nvb" Jun 12 18:38:54.572755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:54.572731 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-d4785c585-68255_25e51ef0-e082-4f46-b419-98bb30325665/nginx/0.log" Jun 12 18:38:54.781303 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:54.781273 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qffz5_76713341-9df1-4f09-9189-11da22647ef0/manager/0.log" Jun 12 18:38:54.890716 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:54.890643 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-cprsd_b6d2b577-ef68-48eb-ae98-bac40aba7704/manager/0.log" Jun 12 18:38:55.214052 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:55.214026 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-x77f5_61354af9-1ed4-4859-8bb1-ba2691b2ad73/server/0.log" Jun 12 18:38:55.331049 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:55.331020 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-shcqs_a7374151-e679-415c-a3dc-cb49a7e4c8c7/manager/0.log" Jun 12 18:38:55.661032 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:55.660957 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-n6gv7_a60ec38d-95dc-4d1f-979b-299fecc48f19/copy-manifests/0.log" Jun 12 18:38:55.667169 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:55.667145 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-n6gv7_a60ec38d-95dc-4d1f-979b-299fecc48f19/manager/0.log" Jun 12 18:38:57.515969 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:57.515937 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qpr9f_2e4de100-3731-4b9f-a9bf-a4f0b00acfe0/manager/0.log" Jun 12 18:38:57.621755 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:57.621723 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2pptp_8f004e0d-d690-4949-b9c6-a5e09f667196/limitador/0.log" Jun 12 18:38:58.166102 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:58.166074 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qstfq_617fbc3e-8dab-4501-889b-ccd77e3fe0b4/discovery/0.log" Jun 12 18:38:58.268627 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:58.268594 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-fxsk9_80bce672-2bbf-4007-95f2-8d09797003b8/kube-auth-proxy/0.log" Jun 12 18:38:58.589281 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:58.589253 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-j598z_ea88d05b-29fb-4c3e-a0b2-39ee99fd1781/payload-pre-processing/0.log" Jun 12 18:38:59.128120 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:59.128085 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd_883052c7-7f44-48b4-8ebb-3ecf9a020177/storage-initializer/0.log" Jun 12 18:38:59.134683 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:59.134656 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7pqvd_883052c7-7f44-48b4-8ebb-3ecf9a020177/main/0.log" Jun 12 18:38:59.233748 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:59.233717 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-n6nvb_48f24848-7c53-4c1c-b873-181bad7917fe/storage-initializer/0.log" Jun 12 18:38:59.239506 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:59.239487 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-n6nvb_48f24848-7c53-4c1c-b873-181bad7917fe/main/0.log" Jun 12 18:38:59.342672 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:59.342644 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd_3f06c86f-6f09-46ea-a963-313601123c04/storage-initializer/0.log" Jun 12 18:38:59.349069 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:38:59.349052 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-mcffd_3f06c86f-6f09-46ea-a963-313601123c04/main/0.log" Jun 12 18:39:06.709557 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:06.709527 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dxr55_01a981c4-8749-4dfb-9096-fe2ff3bc8b7f/global-pull-secret-syncer/0.log" Jun 12 18:39:06.818345 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:06.818315 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rvlgm_c69d2e26-8943-41ed-b91a-a0413fe2aa97/konnectivity-agent/0.log" Jun 12 18:39:06.859337 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:06.859313 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-194.ec2.internal_cee66534c8a708e52ad6bf5e42247133/haproxy/0.log" Jun 12 18:39:11.082841 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:11.082806 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qpr9f_2e4de100-3731-4b9f-a9bf-a4f0b00acfe0/manager/0.log" Jun 12 18:39:11.099556 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:11.099532 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2pptp_8f004e0d-d690-4949-b9c6-a5e09f667196/limitador/0.log" Jun 12 18:39:11.516999 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:11.516977 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-dsp4w_6e41f24b-53b7-4efa-ac34-2a42f62a0923/sail-operator/0.log" Jun 12 18:39:13.023994 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.023970 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/alertmanager/0.log" Jun 12 18:39:13.054538 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.054509 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/config-reloader/0.log" Jun 12 18:39:13.082227 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.082196 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/kube-rbac-proxy-web/0.log" Jun 12 18:39:13.106426 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.106390 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/kube-rbac-proxy/0.log" Jun 12 18:39:13.127917 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.127892 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/kube-rbac-proxy-metric/0.log" Jun 12 18:39:13.148419 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.148393 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/prom-label-proxy/0.log" Jun 12 18:39:13.166603 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.166181 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fbfb868-fe80-47d2-af2d-77142bfebb82/init-config-reloader/0.log" Jun 12 18:39:13.192951 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.192924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-d9hpx_335eacfa-8e80-40b8-9b7e-0dfc82013f9f/cluster-monitoring-operator/0.log" Jun 12 18:39:13.223038 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.223008 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-chhzv_f0b31b12-6297-4db5-912d-8a0c63f51b05/kube-state-metrics/0.log" Jun 12 18:39:13.238596 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.238541 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-chhzv_f0b31b12-6297-4db5-912d-8a0c63f51b05/kube-rbac-proxy-main/0.log" Jun 12 18:39:13.260731 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.260704 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-chhzv_f0b31b12-6297-4db5-912d-8a0c63f51b05/kube-rbac-proxy-self/0.log" Jun 12 18:39:13.319029 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.318950 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-cnvft_e08de8e7-75c7-48e2-b157-a58d01843e5d/monitoring-plugin/0.log" Jun 12 18:39:13.499024 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.498990 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxx4r_76e912ec-bbbc-4273-b9f8-5ab785960ecb/node-exporter/0.log" Jun 12 18:39:13.531766 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.531738 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxx4r_76e912ec-bbbc-4273-b9f8-5ab785960ecb/kube-rbac-proxy/0.log" Jun 12 18:39:13.554363 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.554338 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mxx4r_76e912ec-bbbc-4273-b9f8-5ab785960ecb/init-textfile/0.log" Jun 12 18:39:13.899570 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.899540 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd46785db-kj8px_da7124df-490a-4730-96b5-e6cd14cd46e5/telemeter-client/0.log" Jun 12 18:39:13.918456 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.918427 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd46785db-kj8px_da7124df-490a-4730-96b5-e6cd14cd46e5/reload/0.log" Jun 12 18:39:13.935802 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:13.935769 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cd46785db-kj8px_da7124df-490a-4730-96b5-e6cd14cd46e5/kube-rbac-proxy/0.log" Jun 12 18:39:17.206435 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:17.206402 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-n5d5t_2d1bb578-0083-45e0-b6ef-1a129f8c2660/download-server/0.log" Jun 12 18:39:17.992665 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:17.992626 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk"] Jun 12 18:39:17.996347 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:17.996323 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:17.999379 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:17.999357 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czmgj\"/\"kube-root-ca.crt\"" Jun 12 18:39:18.000359 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.000334 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-czmgj\"/\"default-dockercfg-w4ls6\"" Jun 12 18:39:18.000416 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.000336 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czmgj\"/\"openshift-service-ca.crt\"" Jun 12 18:39:18.006754 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.006721 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk"] Jun 12 18:39:18.106462 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.106427 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-proc\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.106680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.106471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-lib-modules\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.106680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.106569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpdlk\" (UniqueName: \"kubernetes.io/projected/096496bf-99f0-41e5-b828-df3f7d8fb3a2-kube-api-access-tpdlk\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.106680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.106623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-podres\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.106801 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.106693 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-sys\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.207839 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.207800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-proc\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.207839 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.207844 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-lib-modules\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.207894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpdlk\" (UniqueName: \"kubernetes.io/projected/096496bf-99f0-41e5-b828-df3f7d8fb3a2-kube-api-access-tpdlk\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.207915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-podres\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.207935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-proc\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.207957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-sys\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.208005 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-sys\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.208066 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-lib-modules\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.208270 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.208066 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/096496bf-99f0-41e5-b828-df3f7d8fb3a2-podres\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.216172 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.216139 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpdlk\" (UniqueName: \"kubernetes.io/projected/096496bf-99f0-41e5-b828-df3f7d8fb3a2-kube-api-access-tpdlk\") pod \"perf-node-gather-daemonset-gnlsk\" (UID: \"096496bf-99f0-41e5-b828-df3f7d8fb3a2\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.315178 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.315084 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:18.448394 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.448365 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk"] Jun 12 18:39:18.450290 ip-10-0-135-194 kubenswrapper[2557]: W0612 18:39:18.450258 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod096496bf_99f0_41e5_b828_df3f7d8fb3a2.slice/crio-d9c8fd684acee0af1a0df2e7747cadb0f6274df0c8bdace86030e202854fcf02 WatchSource:0}: Error finding container d9c8fd684acee0af1a0df2e7747cadb0f6274df0c8bdace86030e202854fcf02: Status 404 returned error can't find the container with id d9c8fd684acee0af1a0df2e7747cadb0f6274df0c8bdace86030e202854fcf02 Jun 12 18:39:18.486259 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:18.486228 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" event={"ID":"096496bf-99f0-41e5-b828-df3f7d8fb3a2","Type":"ContainerStarted","Data":"d9c8fd684acee0af1a0df2e7747cadb0f6274df0c8bdace86030e202854fcf02"} Jun 12 18:39:19.148729 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.148705 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4b6df_da42943f-19b8-4c9a-a2a6-4e1070faef1b/dns/0.log" Jun 12 18:39:19.165943 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.165912 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4b6df_da42943f-19b8-4c9a-a2a6-4e1070faef1b/kube-rbac-proxy/0.log" Jun 12 18:39:19.274034 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.274005 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fqc2q_9cd5e1fc-6e2d-4494-879d-e524012db41c/dns-node-resolver/0.log" Jun 12 18:39:19.493560 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.493526 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" event={"ID":"096496bf-99f0-41e5-b828-df3f7d8fb3a2","Type":"ContainerStarted","Data":"d49b5d050b5595fc87242f470088126d251bd553f11d99a9a5c81bb0bf0ec2a3"} Jun 12 18:39:19.493762 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.493634 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:19.510190 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.510114 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" podStartSLOduration=2.510097858 podStartE2EDuration="2.510097858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:19.509304816 +0000 UTC m=+1049.078593259" watchObservedRunningTime="2026-06-12 18:39:19.510097858 +0000 UTC m=+1049.079386289" Jun 12 18:39:19.803800 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.803714 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-ffd8d99c7-wjq75_11946b1b-1832-4299-ad35-a877ae2e6efe/registry/0.log" Jun 12 18:39:19.806434 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.806408 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-ffd8d99c7-wjq75_11946b1b-1832-4299-ad35-a877ae2e6efe/registry/1.log" Jun 12 18:39:19.822566 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:19.822540 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wc2q_f69d0418-750d-4952-9161-9d2e947db538/node-ca/0.log" Jun 12 18:39:20.871352 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:20.871319 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qstfq_617fbc3e-8dab-4501-889b-ccd77e3fe0b4/discovery/0.log" Jun 12 18:39:20.887880 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:20.887852 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-fxsk9_80bce672-2bbf-4007-95f2-8d09797003b8/kube-auth-proxy/0.log" Jun 12 18:39:20.957871 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:20.957841 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-j598z_ea88d05b-29fb-4c3e-a0b2-39ee99fd1781/payload-pre-processing/0.log" Jun 12 18:39:21.641892 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:21.641860 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dsgj9_c3d71330-055d-42db-ab4d-ba8feed28ad0/serve-healthcheck-canary/0.log" Jun 12 18:39:22.267479 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:22.267454 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hd6dl_cd74eb39-5b69-4ae2-bf77-f505eeba3367/kube-rbac-proxy/0.log" Jun 12 18:39:22.287092 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:22.287067 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hd6dl_cd74eb39-5b69-4ae2-bf77-f505eeba3367/exporter/0.log" Jun 12 18:39:22.309129 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:22.309108 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hd6dl_cd74eb39-5b69-4ae2-bf77-f505eeba3367/extractor/0.log" Jun 12 18:39:24.587888 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.587860 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-d4785c585-68255_25e51ef0-e082-4f46-b419-98bb30325665/nginx/0.log" Jun 12 18:39:24.633364 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.633334 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-qffz5_76713341-9df1-4f09-9189-11da22647ef0/manager/0.log" Jun 12 18:39:24.661773 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.661742 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-cprsd_b6d2b577-ef68-48eb-ae98-bac40aba7704/manager/0.log" Jun 12 18:39:24.721942 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.721916 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-x77f5_61354af9-1ed4-4859-8bb1-ba2691b2ad73/server/0.log" Jun 12 18:39:24.764563 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.764531 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-shcqs_a7374151-e679-415c-a3dc-cb49a7e4c8c7/manager/0.log" Jun 12 18:39:24.903928 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.903849 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-n6gv7_a60ec38d-95dc-4d1f-979b-299fecc48f19/manager/0.log" Jun 12 18:39:24.927501 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:24.927472 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-n6gv7_a60ec38d-95dc-4d1f-979b-299fecc48f19/copy-manifests/0.log" Jun 12 18:39:25.508947 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:25.508919 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-gnlsk" Jun 12 18:39:32.424582 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:32.424540 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qstfq_617fbc3e-8dab-4501-889b-ccd77e3fe0b4/discovery/0.log" Jun 12 18:39:32.434133 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:32.434107 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-fxsk9_80bce672-2bbf-4007-95f2-8d09797003b8/kube-auth-proxy/0.log" Jun 12 18:39:32.478744 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:32.478718 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-j598z_ea88d05b-29fb-4c3e-a0b2-39ee99fd1781/payload-pre-processing/0.log" Jun 12 18:39:33.361536 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.361511 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/kube-multus-additional-cni-plugins/0.log" Jun 12 18:39:33.382549 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.382528 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/egress-router-binary-copy/0.log" Jun 12 18:39:33.406682 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.406657 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/cni-plugins/0.log" Jun 12 18:39:33.431499 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.431475 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/bond-cni-plugin/0.log" Jun 12 18:39:33.454666 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.454644 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/routeoverride-cni/0.log" Jun 12 18:39:33.478692 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.478672 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/whereabouts-cni-bincopy/0.log" Jun 12 18:39:33.496115 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.496090 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-c9npf_a2d1bc1d-49a9-482c-aceb-42330589f461/whereabouts-cni/0.log" Jun 12 18:39:33.588680 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.588650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qstfq_617fbc3e-8dab-4501-889b-ccd77e3fe0b4/discovery/0.log" Jun 12 18:39:33.599283 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.599255 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-fxsk9_80bce672-2bbf-4007-95f2-8d09797003b8/kube-auth-proxy/0.log" Jun 12 18:39:33.643219 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.643138 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-j598z_ea88d05b-29fb-4c3e-a0b2-39ee99fd1781/payload-pre-processing/0.log" Jun 12 18:39:33.914340 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.914261 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q4ds5_b860d508-4282-4787-94c9-6b8334af983a/kube-multus/0.log" Jun 12 18:39:33.991877 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:33.991847 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-grvbq_095457ce-f584-46da-9ac8-c9d3b8d610a4/network-metrics-daemon/0.log" Jun 12 18:39:34.026306 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:34.026277 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-grvbq_095457ce-f584-46da-9ac8-c9d3b8d610a4/kube-rbac-proxy/0.log" Jun 12 18:39:35.296242 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:35.296214 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-qstfq_617fbc3e-8dab-4501-889b-ccd77e3fe0b4/discovery/0.log" Jun 12 18:39:35.305467 ip-10-0-135-194 kubenswrapper[2557]: I0612 18:39:35.305443 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-fxsk9_80bce672-2bbf-4007-95f2-8d09797003b8/kube-auth-proxy/0.log"