Jun 02 15:23:44.032723 ip-10-0-136-206 systemd[1]: Starting Kubernetes Kubelet... Jun 02 15:23:44.429244 ip-10-0-136-206 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:44.429244 ip-10-0-136-206 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 15:23:44.429244 ip-10-0-136-206 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:44.429244 ip-10-0-136-206 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 15:23:44.429244 ip-10-0-136-206 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 15:23:44.431501 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.431404 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 15:23:44.439552 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439535 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:44.439552 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439549 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:44.439552 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439553 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439557 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439560 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439564 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439566 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439570 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439572 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439582 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439587 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439590 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439594 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439599 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439602 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439605 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439608 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439610 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439613 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439615 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:44.439645 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439618 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439621 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439623 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439626 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439629 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439631 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439634 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439636 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439639 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439641 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439644 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439646 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439649 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439652 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439655 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439658 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439660 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439663 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439665 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439668 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:44.440077 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439670 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439673 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439676 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439678 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439681 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439683 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439686 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439688 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439691 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439693 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439696 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439698 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439701 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439703 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439706 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439709 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439711 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439714 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439717 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439719 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:44.440584 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439722 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439724 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439726 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439729 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439731 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439733 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439737 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439739 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439742 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439744 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439747 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439749 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439751 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439754 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439756 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439759 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439761 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439764 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439766 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439768 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:44.441084 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439770 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439773 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439775 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439778 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439780 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.439783 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440139 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440143 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440146 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440149 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440151 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440154 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440156 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440159 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440161 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440164 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440166 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440169 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440172 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440174 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:44.441593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440176 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440179 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440181 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440184 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440186 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440190 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440193 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440197 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440199 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440202 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440204 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440207 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440209 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440212 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440214 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440217 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440219 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440222 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440225 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:44.442262 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440228 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440230 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440233 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440235 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440238 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440240 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440243 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440245 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440247 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440249 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440252 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440254 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440257 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440259 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440261 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440264 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440266 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440270 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440272 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440274 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:44.443059 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440277 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440279 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440282 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440284 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440287 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440290 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440294 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440297 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440300 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440303 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440305 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440309 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440312 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440314 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440317 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440319 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440323 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440325 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440328 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:44.443593 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440330 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440332 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440335 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440337 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440340 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440342 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440344 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440347 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440349 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440351 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440354 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440356 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440359 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.440361 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441614 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441624 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441630 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441635 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441639 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441642 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 15:23:44.444087 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441646 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441651 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441654 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441657 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441661 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441665 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441668 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441670 2567 flags.go:64] FLAG: --cgroup-root="" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441673 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441677 2567 flags.go:64] FLAG: --client-ca-file="" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441679 2567 flags.go:64] FLAG: --cloud-config="" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441682 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441685 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441689 2567 flags.go:64] FLAG: --cluster-domain="" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441691 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441694 2567 flags.go:64] FLAG: --config-dir="" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441697 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441700 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441704 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441707 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441710 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441713 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441715 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441718 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 15:23:44.444609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441721 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441724 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441727 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441731 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441735 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441738 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441741 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441744 2567 flags.go:64] FLAG: --enable-server="true" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441746 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441915 2567 flags.go:64] FLAG: --event-burst="100" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441924 2567 flags.go:64] FLAG: --event-qps="50" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441931 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441947 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441957 2567 flags.go:64] FLAG: --eviction-hard="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441967 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441975 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.441984 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442001 2567 flags.go:64] FLAG: --eviction-soft="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442009 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442017 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442025 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442033 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442042 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442051 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442059 2567 flags.go:64] FLAG: --feature-gates="" Jun 02 15:23:44.445190 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442074 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442082 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442091 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442099 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442108 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442116 2567 flags.go:64] FLAG: --help="false" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442124 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442133 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442142 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442156 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442170 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442179 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442189 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442197 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442204 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442212 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442220 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442233 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442241 2567 flags.go:64] FLAG: --kube-reserved="" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442248 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442255 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442264 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442271 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442280 2567 flags.go:64] FLAG: --lock-file="" Jun 02 15:23:44.445866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442288 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442296 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442309 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442321 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442329 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442337 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442346 2567 flags.go:64] FLAG: --logging-format="text" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442354 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442363 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442370 2567 flags.go:64] FLAG: --manifest-url="" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442384 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442392 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442397 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442404 2567 flags.go:64] FLAG: --max-pods="110" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442426 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442432 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442436 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442441 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442447 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442457 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442462 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442476 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442481 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442486 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 15:23:44.446495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442491 2567 flags.go:64] FLAG: --pod-cidr="" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442496 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442509 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442513 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442518 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442523 2567 flags.go:64] FLAG: --port="10250" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442528 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442532 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08834a8aa81fb1b79" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442537 2567 flags.go:64] FLAG: --qos-reserved="" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442542 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442551 2567 flags.go:64] FLAG: --register-node="true" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442556 2567 flags.go:64] FLAG: --register-schedulable="true" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442561 2567 flags.go:64] FLAG: --register-with-taints="" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442566 2567 flags.go:64] FLAG: --registry-burst="10" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442570 2567 flags.go:64] FLAG: --registry-qps="5" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442575 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442579 2567 flags.go:64] FLAG: --reserved-memory="" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442585 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442590 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442599 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442604 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442609 2567 flags.go:64] FLAG: --runonce="false" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442613 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442618 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442623 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 02 15:23:44.447119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442627 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442632 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442642 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442647 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442652 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442657 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442662 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442666 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442671 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442677 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442681 2567 flags.go:64] FLAG: --system-cgroups="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442691 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442700 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442705 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442710 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442716 2567 flags.go:64] FLAG: --tls-min-version="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442721 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442725 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442736 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442741 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442746 2567 flags.go:64] FLAG: --v="2" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442752 2567 flags.go:64] FLAG: --version="false" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442759 2567 flags.go:64] FLAG: --vmodule="" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442765 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.442773 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 15:23:44.447761 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443291 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443303 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443310 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443313 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443317 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443320 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443323 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443326 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443329 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443332 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443335 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443337 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443340 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443343 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443345 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443348 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443350 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443353 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443355 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443358 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:44.448376 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443360 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443363 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443366 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443368 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443371 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443374 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443377 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443380 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443382 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443385 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443388 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443390 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443392 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443396 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443399 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443402 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443405 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443407 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443423 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:44.448957 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443427 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443429 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443432 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443436 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443439 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443441 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443444 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443446 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443449 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443451 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443454 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443457 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443459 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443462 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443466 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443470 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443473 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443476 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443479 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443482 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:44.449463 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443484 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443487 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443489 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443492 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443495 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443497 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443500 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443504 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443507 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443510 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443512 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443515 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443517 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443520 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443523 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443525 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443528 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443530 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443533 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443535 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:44.450005 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443538 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443541 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443543 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443546 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443548 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443550 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.443553 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:44.450526 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.444170 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:44.450933 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.450915 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 15:23:44.450963 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.450934 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 15:23:44.450991 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.450982 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:44.450991 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.450988 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:44.450991 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.450991 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.450995 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.450998 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451001 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451004 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451007 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451009 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451012 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451014 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451017 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451020 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451022 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451025 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451028 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451030 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451033 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451036 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451038 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451041 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451043 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:44.451062 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451046 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451048 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451050 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451053 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451055 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451058 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451060 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451063 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451065 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451068 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451071 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451076 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451079 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451082 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451086 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451088 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451091 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451094 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451096 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451099 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:44.451574 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451101 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451104 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451106 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451109 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451111 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451113 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451116 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451118 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451121 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451123 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451125 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451128 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451131 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451133 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451136 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451139 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451142 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451145 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451147 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451149 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:44.452068 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451152 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451154 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451157 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451159 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451161 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451164 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451166 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451170 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451172 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451174 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451177 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451179 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451182 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451184 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451187 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451189 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451191 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451194 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451196 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451198 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:44.452587 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451201 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451203 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451206 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451210 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.451215 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451325 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451330 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451334 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451337 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451339 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451342 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451344 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451347 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451349 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451352 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 15:23:44.453086 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451354 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451357 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451359 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451362 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451364 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451367 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451370 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451372 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451374 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451377 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451379 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451382 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451384 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451387 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451389 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451391 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451394 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451396 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451399 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451401 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 15:23:44.453523 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451404 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451406 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451408 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451429 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451433 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451435 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451440 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451444 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451446 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451450 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451453 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451456 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451459 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451462 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451465 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451468 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451471 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451473 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451476 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 15:23:44.454035 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451479 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451482 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451484 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451486 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451489 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451491 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451494 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451496 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451498 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451501 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451503 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451506 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451508 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451510 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451513 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451516 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451518 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451521 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451523 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451526 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 15:23:44.454554 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451528 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451530 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451533 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451535 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451537 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451540 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451542 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451545 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451547 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451550 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451552 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451554 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451557 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451560 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451562 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451564 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 15:23:44.455119 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:44.451567 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 15:23:44.455593 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.451571 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 15:23:44.455593 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.451683 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 15:23:44.455593 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.454596 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 15:23:44.455593 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.455448 2567 server.go:1019] "Starting client certificate rotation" Jun 02 15:23:44.455593 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.455561 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:23:44.455799 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.455611 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 15:23:44.479572 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.479551 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:23:44.481528 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.481508 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 15:23:44.493612 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.493594 2567 log.go:25] "Validated CRI v1 runtime API" Jun 02 15:23:44.499656 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.499639 2567 log.go:25] "Validated CRI v1 image API" Jun 02 15:23:44.502291 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.502272 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 15:23:44.507289 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.507263 2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b137c9dc-281c-432c-812e-19b31083c044:/dev/nvme0n1p4 b6010f97-21cb-4ada-8a9d-e7b76335b478:/dev/nvme0n1p3] Jun 02 15:23:44.507370 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.507288 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 15:23:44.512032 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.512008 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:23:44.513303 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.513198 2567 manager.go:217] Machine: {Timestamp:2026-06-02 15:23:44.512705935 +0000 UTC m=+0.368625871 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098737 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e18a9de99053ec394db402a733a51 SystemUUID:ec2e18a9-de99-053e-c394-db402a733a51 BootID:4b992011-2f21-41e2-ae56-a2f56c5cb7b1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:95:17:1b:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:95:17:1b:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:b2:88:e6:3d:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 15:23:44.513975 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.513962 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 15:23:44.514106 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.514091 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 15:23:44.515708 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.515687 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 15:23:44.515841 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.515710 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-206.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 15:23:44.515892 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.515847 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 15:23:44.515892 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.515856 2567 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 15:23:44.515892 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.515863 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:23:44.516640 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.516629 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 15:23:44.518252 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.518242 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:23:44.518358 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.518349 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 15:23:44.521238 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.521226 2567 kubelet.go:491] "Attempting to sync node with API server" Jun 02 15:23:44.521277 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.521242 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 15:23:44.521277 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.521258 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 15:23:44.521277 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.521268 2567 kubelet.go:397] "Adding apiserver pod source" Jun 02 15:23:44.521277 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.521276 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 15:23:44.522297 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.522285 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:23:44.522344 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.522304 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 15:23:44.528494 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.528476 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 15:23:44.530498 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.530485 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 15:23:44.532655 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532643 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532660 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532667 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532671 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532680 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532685 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532691 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532696 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532703 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532709 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532717 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 15:23:44.532760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.532723 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 15:23:44.533506 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.533496 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 15:23:44.533548 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.533507 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 15:23:44.536390 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.536364 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 15:23:44.536390 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.536373 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 15:23:44.536671 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.536658 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 15:23:44.536707 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.536701 2567 server.go:1295] "Started kubelet" Jun 02 15:23:44.536860 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.536825 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 15:23:44.536956 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.536872 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 15:23:44.536956 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.536940 2567 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 15:23:44.537440 ip-10-0-136-206 systemd[1]: Started Kubernetes Kubelet. Jun 02 15:23:44.538299 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.538230 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 15:23:44.538751 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.538737 2567 server.go:317] "Adding debug handlers to kubelet server" Jun 02 15:23:44.539383 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.539364 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-206.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 15:23:44.543670 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.543651 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 15:23:44.544187 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.544173 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 15:23:44.547159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.547134 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 15:23:44.547873 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.544936 2567 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 15:23:44.547978 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.547968 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 15:23:44.548186 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548170 2567 factory.go:55] Registering systemd factory Jun 02 15:23:44.548258 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548191 2567 factory.go:223] Registration of the systemd container factory successfully Jun 02 15:23:44.548258 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.548165 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:44.548399 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548379 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76bz5" Jun 02 15:23:44.548399 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548385 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 02 15:23:44.548519 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548406 2567 reconciler.go:26] "Reconciler: start to sync state" Jun 02 15:23:44.548775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548704 2567 factory.go:153] Registering CRI-O factory Jun 02 15:23:44.548775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548725 2567 factory.go:223] Registration of the crio container factory successfully Jun 02 15:23:44.548883 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548785 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 15:23:44.548883 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548803 2567 factory.go:103] Registering Raw factory Jun 02 15:23:44.548883 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.548824 2567 manager.go:1196] Started watching for new ooms in manager Jun 02 15:23:44.549247 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.549230 2567 manager.go:319] Starting recovery of all containers Jun 02 15:23:44.554584 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.554554 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 15:23:44.554690 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.554567 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 15:23:44.554690 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.554602 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-206.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 15:23:44.554806 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.552461 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-206.ec2.internal.18b54cf0bcb3f825 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-206.ec2.internal,UID:ip-10-0-136-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-206.ec2.internal,},FirstTimestamp:2026-06-02 15:23:44.536672293 +0000 UTC m=+0.392592231,LastTimestamp:2026-06-02 15:23:44.536672293 +0000 UTC m=+0.392592231,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-206.ec2.internal,}" Jun 02 15:23:44.556535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.556516 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76bz5" Jun 02 15:23:44.562353 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.562334 2567 manager.go:324] Recovery completed Jun 02 15:23:44.566301 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.566288 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:44.571383 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.571369 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:44.571457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.571396 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:44.571457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.571407 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:44.571912 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.571898 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 15:23:44.571974 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.571912 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 15:23:44.571974 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.571930 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 15:23:44.573423 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.573312 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-206.ec2.internal.18b54cf0bec59fc0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-206.ec2.internal,UID:ip-10-0-136-206.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-206.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-206.ec2.internal,},FirstTimestamp:2026-06-02 15:23:44.571383744 +0000 UTC m=+0.427303679,LastTimestamp:2026-06-02 15:23:44.571383744 +0000 UTC m=+0.427303679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-206.ec2.internal,}" Jun 02 15:23:44.574475 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.574460 2567 policy_none.go:49] "None policy: Start" Jun 02 15:23:44.574544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.574482 2567 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 15:23:44.574544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.574498 2567 state_mem.go:35] "Initializing new in-memory state store" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613085 2567 manager.go:341] "Starting Device Plugin manager" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.613121 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613134 2567 server.go:85] "Starting device plugin registration server" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613397 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613431 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613554 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613627 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613636 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 15:23:44.614146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.613900 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 15:23:44.614585 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.614331 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 15:23:44.614585 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.614521 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:44.615318 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.615302 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 15:23:44.615363 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.615324 2567 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 15:23:44.615363 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.615339 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 15:23:44.615363 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.615349 2567 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 15:23:44.615520 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.615445 2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 15:23:44.620153 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.620135 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:44.714687 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.714586 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:44.715533 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.715510 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal"] Jun 02 15:23:44.715533 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.715530 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:44.715653 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.715561 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:44.715653 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.715574 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:44.715653 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.715583 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:44.715653 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.715595 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.717639 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.717605 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:44.717736 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.717647 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:44.717736 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.717659 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:44.718733 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.718721 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:44.718865 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.718853 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.718923 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.718882 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:44.719442 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.719395 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:44.719442 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.719405 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:44.719442 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.719443 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:44.719600 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.719444 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:44.719600 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.719459 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:44.719600 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.719468 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:44.720591 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.720577 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.720637 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.720603 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 15:23:44.721221 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.721206 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientMemory" Jun 02 15:23:44.721280 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.721231 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 15:23:44.721280 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.721241 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeHasSufficientPID" Jun 02 15:23:44.725390 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.725308 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.725390 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.725331 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-206.ec2.internal\": node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:44.740330 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.740311 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:44.743078 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.743064 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-206.ec2.internal\" not found" node="ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.746435 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.746405 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-206.ec2.internal\" not found" node="ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.749559 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.749543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7296e4bb7db9da23f25467c143289b43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal\" (UID: \"7296e4bb7db9da23f25467c143289b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.749646 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.749567 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7296e4bb7db9da23f25467c143289b43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal\" (UID: \"7296e4bb7db9da23f25467c143289b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.749646 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.749585 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dafe25634ae07728f9205f8aca9d250b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-206.ec2.internal\" (UID: \"dafe25634ae07728f9205f8aca9d250b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.840932 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.840892 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:44.849756 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.849726 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7296e4bb7db9da23f25467c143289b43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal\" (UID: \"7296e4bb7db9da23f25467c143289b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.849856 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.849765 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7296e4bb7db9da23f25467c143289b43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal\" (UID: \"7296e4bb7db9da23f25467c143289b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.849856 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.849784 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dafe25634ae07728f9205f8aca9d250b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-206.ec2.internal\" (UID: \"dafe25634ae07728f9205f8aca9d250b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.849856 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.849829 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7296e4bb7db9da23f25467c143289b43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal\" (UID: \"7296e4bb7db9da23f25467c143289b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.849989 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.849833 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dafe25634ae07728f9205f8aca9d250b-config\") pod \"kube-apiserver-proxy-ip-10-0-136-206.ec2.internal\" (UID: \"dafe25634ae07728f9205f8aca9d250b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.849989 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:44.849863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7296e4bb7db9da23f25467c143289b43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal\" (UID: \"7296e4bb7db9da23f25467c143289b43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:44.942030 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:44.941999 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.042564 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.042535 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.045716 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.045699 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:45.050536 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.050367 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" Jun 02 15:23:45.143504 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.143478 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.244102 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.244078 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.344708 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.344638 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.445356 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.445320 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.455755 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.455735 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 15:23:45.455894 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.455868 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 15:23:45.544142 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.544108 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 15:23:45.545965 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.545934 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.556536 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.556514 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:45.557545 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:45.557522 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddafe25634ae07728f9205f8aca9d250b.slice/crio-aa1d15bbae3f78bb261f1060aa88180b688e29e32dae84e9ddfd8430fb92162c WatchSource:0}: Error finding container aa1d15bbae3f78bb261f1060aa88180b688e29e32dae84e9ddfd8430fb92162c: Status 404 returned error can't find the container with id aa1d15bbae3f78bb261f1060aa88180b688e29e32dae84e9ddfd8430fb92162c Jun 02 15:23:45.557795 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:45.557775 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7296e4bb7db9da23f25467c143289b43.slice/crio-7363b69dacc550751de6fc68b585a28fa2fa8b6d3207d2f0a94777bd3325f866 WatchSource:0}: Error finding container 7363b69dacc550751de6fc68b585a28fa2fa8b6d3207d2f0a94777bd3325f866: Status 404 returned error can't find the container with id 7363b69dacc550751de6fc68b585a28fa2fa8b6d3207d2f0a94777bd3325f866 Jun 02 15:23:45.558881 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.558853 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 15:18:44 +0000 UTC" deadline="2028-01-19 02:59:59.95255267 +0000 UTC" Jun 02 15:23:45.558927 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.558884 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14291h36m14.393672089s" Jun 02 15:23:45.560870 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.560858 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:23:45.562340 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.562321 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 15:23:45.591651 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.591628 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7brj8" Jun 02 15:23:45.601618 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.601566 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7brj8" Jun 02 15:23:45.618111 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.618072 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" event={"ID":"dafe25634ae07728f9205f8aca9d250b","Type":"ContainerStarted","Data":"aa1d15bbae3f78bb261f1060aa88180b688e29e32dae84e9ddfd8430fb92162c"} Jun 02 15:23:45.619030 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.619012 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" event={"ID":"7296e4bb7db9da23f25467c143289b43","Type":"ContainerStarted","Data":"7363b69dacc550751de6fc68b585a28fa2fa8b6d3207d2f0a94777bd3325f866"} Jun 02 15:23:45.646201 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.646181 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.746659 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:45.746635 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-206.ec2.internal\" not found" Jun 02 15:23:45.786766 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.786749 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:45.787229 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.787211 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:45.845717 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.845695 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" Jun 02 15:23:45.860828 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.860760 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:23:45.861844 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.861829 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" Jun 02 15:23:45.872798 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:45.872776 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 15:23:46.274911 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.274882 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 15:23:46.522934 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.522902 2567 apiserver.go:52] "Watching apiserver" Jun 02 15:23:46.528966 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.528896 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 15:23:46.530191 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.530140 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr","openshift-cluster-node-tuning-operator/tuned-5stt8","openshift-dns/node-resolver-2h25t","openshift-network-diagnostics/network-check-target-nhfj8","openshift-ovn-kubernetes/ovnkube-node-7vsst","kube-system/konnectivity-agent-grt4p","kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal","openshift-image-registry/node-ca-xch9g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal","openshift-multus/multus-additional-cni-plugins-k97rk","openshift-multus/multus-vrn4x","openshift-multus/network-metrics-daemon-db66h","openshift-network-operator/iptables-alerter-gwq59"] Jun 02 15:23:46.532425 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.532389 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.535068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.534599 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.535068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.534967 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 15:23:46.535068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.534973 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 15:23:46.535068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.534988 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 15:23:46.536006 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.535976 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6rr5r\"" Jun 02 15:23:46.536084 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.536038 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:46.536139 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.536115 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:46.536316 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.534976 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.536682 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.536663 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.536791 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.536774 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.537131 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.537104 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.537946 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.537925 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8f7hx\"" Jun 02 15:23:46.538379 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.538357 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.538855 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.538794 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.539182 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.539164 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.539285 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.539252 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.540063 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.540047 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rm728\"" Jun 02 15:23:46.541011 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.540977 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 15:23:46.541506 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.541489 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 15:23:46.541949 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.541934 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zlk47\"" Jun 02 15:23:46.542096 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.542075 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.542327 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.542308 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.542397 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.542318 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 15:23:46.542539 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.542522 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 15:23:46.545675 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.545640 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.546795 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.546781 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.548363 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.548345 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.548803 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.548788 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wbvgz\"" Jun 02 15:23:46.548931 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.548800 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 15:23:46.549014 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.548830 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 15:23:46.549671 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.549651 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.550336 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.550315 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.550699 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.550684 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-htrx7\"" Jun 02 15:23:46.550813 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.550794 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.551117 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.551088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:46.551215 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.551169 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.551861 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lh2bj\"" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552055 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552246 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552302 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552402 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552473 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552498 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bz98q\"" Jun 02 15:23:46.553306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.552593 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.554722 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.554706 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:23:46.554838 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.554818 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 15:23:46.555121 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.555103 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 15:23:46.555236 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.555178 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sw44v\"" Jun 02 15:23:46.557706 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557673 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysctl-conf\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.557706 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysconfig\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.557706 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557718 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-kubernetes\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557741 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-ovnkube-config\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-socket-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-sys\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557824 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-modprobe-d\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-tuned\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-etc-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-log-socket\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557935 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.557977 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-os-release\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.558035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-cni-binary-copy\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76a4adf4-a9b4-43fc-b264-7c089c010e79-konnectivity-ca\") pod \"konnectivity-agent-grt4p\" (UID: \"76a4adf4-a9b4-43fc-b264-7c089c010e79\") " pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558073 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-device-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558123 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-system-cni-dir\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558149 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558177 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-systemd-units\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558210 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-env-overrides\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76a4adf4-a9b4-43fc-b264-7c089c010e79-agent-certs\") pod \"konnectivity-agent-grt4p\" (UID: \"76a4adf4-a9b4-43fc-b264-7c089c010e79\") " pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558294 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b11358fd-dc75-4117-98a5-69be726c6687-ovn-node-metrics-cert\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558323 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-lib-modules\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558350 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysctl-d\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558395 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-var-lib-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558444 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-run-ovn-kubernetes\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-cni-bin\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558490 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.558724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558513 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-sys-fs\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-var-lib-kubelet\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558615 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6p9s\" (UniqueName: \"kubernetes.io/projected/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-kube-api-access-w6p9s\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558649 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558674 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-cnibin\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-systemd\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558726 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-run\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-tmp\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558774 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b180344-0602-431e-b552-8e7144e52fd9-host\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-systemd\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558895 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-ovn\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558920 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn87d\" (UniqueName: \"kubernetes.io/projected/7808d353-cc9b-43cb-9257-8e023ae2837c-kube-api-access-zn87d\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17ace113-3104-4a14-a812-3ec1dcd632e4-tmp-dir\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558970 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-kubelet\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.558992 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-run-netns\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.559561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-slash\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559069 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-node-log\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559107 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7grt\" (UniqueName: \"kubernetes.io/projected/2b180344-0602-431e-b552-8e7144e52fd9-kube-api-access-b7grt\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559167 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2tpb\" (UniqueName: \"kubernetes.io/projected/426b4625-cbda-4bcd-b664-9a929fbf341f-kube-api-access-v2tpb\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559195 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-registration-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17ace113-3104-4a14-a812-3ec1dcd632e4-hosts-file\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559352 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hl84\" (UniqueName: \"kubernetes.io/projected/17ace113-3104-4a14-a812-3ec1dcd632e4-kube-api-access-4hl84\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559377 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-cni-netd\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-ovnkube-script-lib\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxw2\" (UniqueName: \"kubernetes.io/projected/b11358fd-dc75-4117-98a5-69be726c6687-kube-api-access-tvxw2\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b180344-0602-431e-b552-8e7144e52fd9-serviceca\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.560308 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.559547 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-host\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.602581 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.602551 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:18:45 +0000 UTC" deadline="2027-11-19 14:40:48.758321186 +0000 UTC" Jun 02 15:23:46.602581 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.602575 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12839h17m2.155749153s" Jun 02 15:23:46.648119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.648094 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 15:23:46.660144 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660122 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17ace113-3104-4a14-a812-3ec1dcd632e4-tmp-dir\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660148 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-kubelet\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660164 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-run-netns\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660188 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660203 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-slash\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660218 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-node-log\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660234 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7grt\" (UniqueName: \"kubernetes.io/projected/2b180344-0602-431e-b552-8e7144e52fd9-kube-api-access-b7grt\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.660261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660251 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2tpb\" (UniqueName: \"kubernetes.io/projected/426b4625-cbda-4bcd-b664-9a929fbf341f-kube-api-access-v2tpb\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660278 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-registration-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660294 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660310 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17ace113-3104-4a14-a812-3ec1dcd632e4-hosts-file\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660325 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hl84\" (UniqueName: \"kubernetes.io/projected/17ace113-3104-4a14-a812-3ec1dcd632e4-kube-api-access-4hl84\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660348 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-cni-netd\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660372 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-ovnkube-script-lib\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660390 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxw2\" (UniqueName: \"kubernetes.io/projected/b11358fd-dc75-4117-98a5-69be726c6687-kube-api-access-tvxw2\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660405 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b180344-0602-431e-b552-8e7144e52fd9-serviceca\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660441 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-host\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660458 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17ace113-3104-4a14-a812-3ec1dcd632e4-tmp-dir\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660476 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crp29\" (UniqueName: \"kubernetes.io/projected/082de97f-3812-4678-9c84-c47f8a51889b-kube-api-access-crp29\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660494 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-k8s-cni-cncf-io\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660517 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysctl-conf\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.660544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660546 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-socket-dir-parent\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660555 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660567 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysconfig\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660583 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-kubernetes\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-kubelet\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660607 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-ovnkube-config\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660659 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-run-netns\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660760 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-slash\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.661044 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.660835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-node-log\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.661374 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661243 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-socket-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.661374 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661284 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-cnibin\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.661374 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661319 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-sys\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661374 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661345 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-modprobe-d\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661374 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661354 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-registration-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.661589 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661370 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-tuned\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661589 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17ace113-3104-4a14-a812-3ec1dcd632e4-hosts-file\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.661662 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysctl-conf\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661726 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-ovnkube-config\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.661775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661729 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysconfig\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661731 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 15:23:46.661893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661767 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-host\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661826 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-sys\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.661893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661825 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-os-release\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.661893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-conf-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.661893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-socket-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-modprobe-d\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661875 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-kubernetes\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661905 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-etc-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-etc-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661953 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-log-socket\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661981 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-log-socket\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.661981 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-os-release\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-cni-netd\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662023 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b180344-0602-431e-b552-8e7144e52fd9-serviceca\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662036 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662042 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-ovnkube-script-lib\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662072 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgvwz\" (UniqueName: \"kubernetes.io/projected/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-kube-api-access-qgvwz\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662082 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-os-release\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.662116 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662097 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-multus-certs\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662124 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-cni-binary-copy\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662146 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76a4adf4-a9b4-43fc-b264-7c089c010e79-konnectivity-ca\") pod \"konnectivity-agent-grt4p\" (UID: \"76a4adf4-a9b4-43fc-b264-7c089c010e79\") " pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662188 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-device-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662237 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-device-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662247 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-system-cni-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662284 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662313 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-system-cni-dir\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662341 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662369 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-systemd-units\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-system-cni-dir\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662393 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-env-overrides\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662479 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76a4adf4-a9b4-43fc-b264-7c089c010e79-agent-certs\") pod \"konnectivity-agent-grt4p\" (UID: \"76a4adf4-a9b4-43fc-b264-7c089c010e79\") " pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662509 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/082de97f-3812-4678-9c84-c47f8a51889b-host-slash\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662553 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-cni-bin\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662581 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b11358fd-dc75-4117-98a5-69be726c6687-ovn-node-metrics-cert\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662609 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/082de97f-3812-4678-9c84-c47f8a51889b-iptables-alerter-script\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.662880 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662636 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-netns\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662663 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-daemon-config\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662692 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-etc-kubernetes\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662718 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-lib-modules\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysctl-d\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662773 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-var-lib-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662798 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-run-ovn-kubernetes\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662811 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76a4adf4-a9b4-43fc-b264-7c089c010e79-konnectivity-ca\") pod \"konnectivity-agent-grt4p\" (UID: \"76a4adf4-a9b4-43fc-b264-7c089c010e79\") " pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662817 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-cni-binary-copy\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662825 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-cni-bin\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662870 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662885 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-systemd-units\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662923 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-cni-bin\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662939 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-sys-fs\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.662963 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-host-run-ovn-kubernetes\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663109 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-sys-fs\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.663613 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663167 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-var-lib-kubelet\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663196 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6p9s\" (UniqueName: \"kubernetes.io/projected/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-kube-api-access-w6p9s\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663221 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-cnibin\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-cni-binary-copy\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663299 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-cni-multus\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663319 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrmz5\" (UniqueName: \"kubernetes.io/projected/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-kube-api-access-xrmz5\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663346 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-systemd\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663361 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b11358fd-dc75-4117-98a5-69be726c6687-env-overrides\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663370 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-run\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663395 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-tmp\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663453 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b180344-0602-431e-b552-8e7144e52fd9-host\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663484 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663506 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663512 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-cni-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-run\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663536 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/426b4625-cbda-4bcd-b664-9a929fbf341f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.664584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-kubelet\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663590 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-systemd\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663593 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-systemd\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663635 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-var-lib-openvswitch\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663642 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/426b4625-cbda-4bcd-b664-9a929fbf341f-cnibin\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-var-lib-kubelet\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663663 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-sysctl-d\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-systemd\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-ovn\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663718 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7808d353-cc9b-43cb-9257-8e023ae2837c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663741 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-lib-modules\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663750 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zn87d\" (UniqueName: \"kubernetes.io/projected/7808d353-cc9b-43cb-9257-8e023ae2837c-kube-api-access-zn87d\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b11358fd-dc75-4117-98a5-69be726c6687-run-ovn\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663780 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-hostroot\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.665384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.663804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b180344-0602-431e-b552-8e7144e52fd9-host\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.666083 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.665893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-tmp\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.666083 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.665922 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-etc-tuned\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.666280 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.666265 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b11358fd-dc75-4117-98a5-69be726c6687-ovn-node-metrics-cert\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.666324 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.666303 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76a4adf4-a9b4-43fc-b264-7c089c010e79-agent-certs\") pod \"konnectivity-agent-grt4p\" (UID: \"76a4adf4-a9b4-43fc-b264-7c089c010e79\") " pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.671768 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.671743 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:46.671768 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.671771 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:46.671955 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.671783 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:46.671955 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.671848 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:23:47.171829212 +0000 UTC m=+3.027749142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:46.673661 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.673489 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7grt\" (UniqueName: \"kubernetes.io/projected/2b180344-0602-431e-b552-8e7144e52fd9-kube-api-access-b7grt\") pod \"node-ca-xch9g\" (UID: \"2b180344-0602-431e-b552-8e7144e52fd9\") " pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.674623 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.674602 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hl84\" (UniqueName: \"kubernetes.io/projected/17ace113-3104-4a14-a812-3ec1dcd632e4-kube-api-access-4hl84\") pod \"node-resolver-2h25t\" (UID: \"17ace113-3104-4a14-a812-3ec1dcd632e4\") " pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.675327 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.675305 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxw2\" (UniqueName: \"kubernetes.io/projected/b11358fd-dc75-4117-98a5-69be726c6687-kube-api-access-tvxw2\") pod \"ovnkube-node-7vsst\" (UID: \"b11358fd-dc75-4117-98a5-69be726c6687\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.675746 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.675727 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2tpb\" (UniqueName: \"kubernetes.io/projected/426b4625-cbda-4bcd-b664-9a929fbf341f-kube-api-access-v2tpb\") pod \"multus-additional-cni-plugins-k97rk\" (UID: \"426b4625-cbda-4bcd-b664-9a929fbf341f\") " pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.676696 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.676679 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6p9s\" (UniqueName: \"kubernetes.io/projected/3f4c1d9a-3383-4e2e-aef9-e5a586b47a08-kube-api-access-w6p9s\") pod \"tuned-5stt8\" (UID: \"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08\") " pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.676952 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.676934 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn87d\" (UniqueName: \"kubernetes.io/projected/7808d353-cc9b-43cb-9257-8e023ae2837c-kube-api-access-zn87d\") pod \"aws-ebs-csi-driver-node-ltgdr\" (UID: \"7808d353-cc9b-43cb-9257-8e023ae2837c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.764919 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.764885 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crp29\" (UniqueName: \"kubernetes.io/projected/082de97f-3812-4678-9c84-c47f8a51889b-kube-api-access-crp29\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.764919 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.764920 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-k8s-cni-cncf-io\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.764936 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-socket-dir-parent\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.764963 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-cnibin\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765022 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-k8s-cni-cncf-io\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765031 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-cnibin\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765050 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-socket-dir-parent\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765060 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-os-release\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765106 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-conf-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765137 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765171 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qgvwz\" (UniqueName: \"kubernetes.io/projected/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-kube-api-access-qgvwz\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765174 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-conf-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765194 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-os-release\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765201 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-multus-certs\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765239 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-multus-certs\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765248 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-system-cni-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.765258 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765282 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-system-cni-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765302 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/082de97f-3812-4678-9c84-c47f8a51889b-host-slash\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765328 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-cni-bin\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:46.765347 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:23:47.265324443 +0000 UTC m=+3.121244371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765385 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/082de97f-3812-4678-9c84-c47f8a51889b-host-slash\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765364 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-cni-bin\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.765470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765383 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/082de97f-3812-4678-9c84-c47f8a51889b-iptables-alerter-script\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765487 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-netns\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765525 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-daemon-config\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765527 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-run-netns\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765542 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-etc-kubernetes\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765580 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-cni-binary-copy\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765599 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-cni-multus\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765618 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrmz5\" (UniqueName: \"kubernetes.io/projected/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-kube-api-access-xrmz5\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765619 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-etc-kubernetes\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765640 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-cni-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765682 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-kubelet\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765688 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-cni-multus\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765721 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-hostroot\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765725 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-host-var-lib-kubelet\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765762 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-hostroot\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765815 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-cni-dir\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.765959 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/082de97f-3812-4678-9c84-c47f8a51889b-iptables-alerter-script\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.766159 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.766139 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-multus-daemon-config\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.766819 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.766201 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-cni-binary-copy\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.777360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.777334 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrmz5\" (UniqueName: \"kubernetes.io/projected/92aeaf74-4c7f-41df-bcc5-4784e0130b1f-kube-api-access-xrmz5\") pod \"multus-vrn4x\" (UID: \"92aeaf74-4c7f-41df-bcc5-4784e0130b1f\") " pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.777360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.777353 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgvwz\" (UniqueName: \"kubernetes.io/projected/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-kube-api-access-qgvwz\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:46.777530 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.777355 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crp29\" (UniqueName: \"kubernetes.io/projected/082de97f-3812-4678-9c84-c47f8a51889b-kube-api-access-crp29\") pod \"iptables-alerter-gwq59\" (UID: \"082de97f-3812-4678-9c84-c47f8a51889b\") " pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:46.849424 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.849334 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k97rk" Jun 02 15:23:46.857106 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.857085 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5stt8" Jun 02 15:23:46.866592 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.866574 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2h25t" Jun 02 15:23:46.874226 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.874204 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:23:46.879818 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.879790 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:23:46.887294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.887278 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xch9g" Jun 02 15:23:46.895881 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.895863 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" Jun 02 15:23:46.903483 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.903463 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrn4x" Jun 02 15:23:46.910035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:46.910018 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwq59" Jun 02 15:23:47.269563 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.269532 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:47.269563 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.269573 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:47.269791 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:47.269675 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:47.269791 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:47.269685 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:47.269791 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:47.269699 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:47.269791 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:47.269710 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:47.269791 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:47.269738 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:23:48.269720723 +0000 UTC m=+4.125640647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:47.269791 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:47.269754 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:23:48.2697469 +0000 UTC m=+4.125666827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:47.422124 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.421449 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11358fd_dc75_4117_98a5_69be726c6687.slice/crio-09f0a4785fa28af4d906e1f62cd6aa5a7330c9c23e53a9b4ad82d4bf468c1b32 WatchSource:0}: Error finding container 09f0a4785fa28af4d906e1f62cd6aa5a7330c9c23e53a9b4ad82d4bf468c1b32: Status 404 returned error can't find the container with id 09f0a4785fa28af4d906e1f62cd6aa5a7330c9c23e53a9b4ad82d4bf468c1b32 Jun 02 15:23:47.423269 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.422734 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b180344_0602_431e_b552_8e7144e52fd9.slice/crio-232a3672a5f683313b5b2ffa95490a3be698a1790fdaa030adca331e60479558 WatchSource:0}: Error finding container 232a3672a5f683313b5b2ffa95490a3be698a1790fdaa030adca331e60479558: Status 404 returned error can't find the container with id 232a3672a5f683313b5b2ffa95490a3be698a1790fdaa030adca331e60479558 Jun 02 15:23:47.424147 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.424114 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7808d353_cc9b_43cb_9257_8e023ae2837c.slice/crio-044e5a527cc2d14401b0846f1d71a4e5ae8c75c01985e017c0ab25edbb0d5eb3 WatchSource:0}: Error finding container 044e5a527cc2d14401b0846f1d71a4e5ae8c75c01985e017c0ab25edbb0d5eb3: Status 404 returned error can't find the container with id 044e5a527cc2d14401b0846f1d71a4e5ae8c75c01985e017c0ab25edbb0d5eb3 Jun 02 15:23:47.425394 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.425354 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ace113_3104_4a14_a812_3ec1dcd632e4.slice/crio-079d8a66082352a2dd2c8e8e9e228007fcf5071edbbfc8de9e88cd3143b2a29e WatchSource:0}: Error finding container 079d8a66082352a2dd2c8e8e9e228007fcf5071edbbfc8de9e88cd3143b2a29e: Status 404 returned error can't find the container with id 079d8a66082352a2dd2c8e8e9e228007fcf5071edbbfc8de9e88cd3143b2a29e Jun 02 15:23:47.427783 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.427760 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082de97f_3812_4678_9c84_c47f8a51889b.slice/crio-e5811d8262dce0907c6787d9e6d709fe3cbc4ea283992f8e767decee0b16baa0 WatchSource:0}: Error finding container e5811d8262dce0907c6787d9e6d709fe3cbc4ea283992f8e767decee0b16baa0: Status 404 returned error can't find the container with id e5811d8262dce0907c6787d9e6d709fe3cbc4ea283992f8e767decee0b16baa0 Jun 02 15:23:47.428682 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.428655 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426b4625_cbda_4bcd_b664_9a929fbf341f.slice/crio-ac9c5b62112a1c8eb4a2c23b6dc927f821c6bd7c907a6f47ef81b90833c06a2a WatchSource:0}: Error finding container ac9c5b62112a1c8eb4a2c23b6dc927f821c6bd7c907a6f47ef81b90833c06a2a: Status 404 returned error can't find the container with id ac9c5b62112a1c8eb4a2c23b6dc927f821c6bd7c907a6f47ef81b90833c06a2a Jun 02 15:23:47.429609 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.429504 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92aeaf74_4c7f_41df_bcc5_4784e0130b1f.slice/crio-b05d3cbaa56e25bcc1863ae3e71222358582b1623f8367cf1be27baae33375f1 WatchSource:0}: Error finding container b05d3cbaa56e25bcc1863ae3e71222358582b1623f8367cf1be27baae33375f1: Status 404 returned error can't find the container with id b05d3cbaa56e25bcc1863ae3e71222358582b1623f8367cf1be27baae33375f1 Jun 02 15:23:47.430898 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.430874 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a4adf4_a9b4_43fc_b264_7c089c010e79.slice/crio-d49d48f046128c3d48650cc69734cc00d47a99d94516f6cf2d10d6997b8fe8e5 WatchSource:0}: Error finding container d49d48f046128c3d48650cc69734cc00d47a99d94516f6cf2d10d6997b8fe8e5: Status 404 returned error can't find the container with id d49d48f046128c3d48650cc69734cc00d47a99d94516f6cf2d10d6997b8fe8e5 Jun 02 15:23:47.431851 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:23:47.431525 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4c1d9a_3383_4e2e_aef9_e5a586b47a08.slice/crio-bb380f3ff4d94f92fc2f7a95e54d256411f7bbd0bf68a1f146bc5f9f5beff0c0 WatchSource:0}: Error finding container bb380f3ff4d94f92fc2f7a95e54d256411f7bbd0bf68a1f146bc5f9f5beff0c0: Status 404 returned error can't find the container with id bb380f3ff4d94f92fc2f7a95e54d256411f7bbd0bf68a1f146bc5f9f5beff0c0 Jun 02 15:23:47.603777 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.603699 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 15:18:45 +0000 UTC" deadline="2028-03-12 14:19:28.05091215 +0000 UTC" Jun 02 15:23:47.603777 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.603727 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15574h55m40.447186899s" Jun 02 15:23:47.622751 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.622719 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"09f0a4785fa28af4d906e1f62cd6aa5a7330c9c23e53a9b4ad82d4bf468c1b32"} Jun 02 15:23:47.624211 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.624180 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" event={"ID":"dafe25634ae07728f9205f8aca9d250b","Type":"ContainerStarted","Data":"540bfbc34691b0849c5546df73d2e372d34683b25dec965e8bb9a072b4fbf0cb"} Jun 02 15:23:47.625114 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.625087 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-grt4p" event={"ID":"76a4adf4-a9b4-43fc-b264-7c089c010e79","Type":"ContainerStarted","Data":"d49d48f046128c3d48650cc69734cc00d47a99d94516f6cf2d10d6997b8fe8e5"} Jun 02 15:23:47.627181 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.627153 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrn4x" event={"ID":"92aeaf74-4c7f-41df-bcc5-4784e0130b1f","Type":"ContainerStarted","Data":"b05d3cbaa56e25bcc1863ae3e71222358582b1623f8367cf1be27baae33375f1"} Jun 02 15:23:47.628565 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.628546 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerStarted","Data":"ac9c5b62112a1c8eb4a2c23b6dc927f821c6bd7c907a6f47ef81b90833c06a2a"} Jun 02 15:23:47.629387 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.629364 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwq59" event={"ID":"082de97f-3812-4678-9c84-c47f8a51889b","Type":"ContainerStarted","Data":"e5811d8262dce0907c6787d9e6d709fe3cbc4ea283992f8e767decee0b16baa0"} Jun 02 15:23:47.630689 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.630668 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5stt8" event={"ID":"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08","Type":"ContainerStarted","Data":"bb380f3ff4d94f92fc2f7a95e54d256411f7bbd0bf68a1f146bc5f9f5beff0c0"} Jun 02 15:23:47.631832 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.631813 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2h25t" event={"ID":"17ace113-3104-4a14-a812-3ec1dcd632e4","Type":"ContainerStarted","Data":"079d8a66082352a2dd2c8e8e9e228007fcf5071edbbfc8de9e88cd3143b2a29e"} Jun 02 15:23:47.632733 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.632713 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xch9g" event={"ID":"2b180344-0602-431e-b552-8e7144e52fd9","Type":"ContainerStarted","Data":"232a3672a5f683313b5b2ffa95490a3be698a1790fdaa030adca331e60479558"} Jun 02 15:23:47.633864 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.633846 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" event={"ID":"7808d353-cc9b-43cb-9257-8e023ae2837c","Type":"ContainerStarted","Data":"044e5a527cc2d14401b0846f1d71a4e5ae8c75c01985e017c0ab25edbb0d5eb3"} Jun 02 15:23:47.647718 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:47.647681 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-206.ec2.internal" podStartSLOduration=2.6476684969999997 podStartE2EDuration="2.647668497s" podCreationTimestamp="2026-06-02 15:23:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:23:47.647508486 +0000 UTC m=+3.503428432" watchObservedRunningTime="2026-06-02 15:23:47.647668497 +0000 UTC m=+3.503588443" Jun 02 15:23:48.277657 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:48.277383 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:48.277856 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:48.277762 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:48.277923 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.277571 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:48.277923 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.277910 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:48.278028 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.277924 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:48.278028 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.277984 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:23:50.277964881 +0000 UTC m=+6.133884810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:48.278310 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.277886 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:48.278398 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.278351 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:23:50.278334757 +0000 UTC m=+6.134254683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:48.618681 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:48.617872 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:48.618681 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.617987 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:48.618681 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:48.618133 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:48.618681 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:48.618262 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:48.646295 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:48.645376 2567 generic.go:358] "Generic (PLEG): container finished" podID="7296e4bb7db9da23f25467c143289b43" containerID="47b317f7405e4abd7f8715585271967546fab2884d8991fb296588a2e016a2fa" exitCode=0 Jun 02 15:23:48.646295 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:48.646117 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" event={"ID":"7296e4bb7db9da23f25467c143289b43","Type":"ContainerDied","Data":"47b317f7405e4abd7f8715585271967546fab2884d8991fb296588a2e016a2fa"} Jun 02 15:23:49.669337 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:49.669274 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" event={"ID":"7296e4bb7db9da23f25467c143289b43","Type":"ContainerStarted","Data":"6508f5e683d6faf52b9386f65ab5d00cd87100847df6077ba623c0f31a019da0"} Jun 02 15:23:50.294456 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:50.294009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:50.294456 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:50.294062 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:50.294456 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.294228 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:50.294456 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.294247 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:50.294456 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.294259 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:50.294456 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.294324 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:23:54.294304593 +0000 UTC m=+10.150224519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:50.294896 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.294759 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:50.294896 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.294809 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:23:54.294793264 +0000 UTC m=+10.150713189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:50.616582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:50.616514 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:50.616740 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.616658 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:50.616740 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:50.616716 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:50.616855 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:50.616823 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:52.616501 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:52.616463 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:52.616945 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:52.616593 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:52.617009 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:52.616993 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:52.617081 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:52.617066 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:54.329194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.329156 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:54.329714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.329216 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:54.329714 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.329359 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:23:54.329714 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.329380 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:23:54.329714 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.329393 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:54.329714 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.329473 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:24:02.329453545 +0000 UTC m=+18.185373469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:23:54.329983 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.329901 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:54.329983 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.329958 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:24:02.329940701 +0000 UTC m=+18.185860644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:23:54.451874 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.451820 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-206.ec2.internal" podStartSLOduration=9.451802944 podStartE2EDuration="9.451802944s" podCreationTimestamp="2026-06-02 15:23:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:23:49.712993931 +0000 UTC m=+5.568913876" watchObservedRunningTime="2026-06-02 15:23:54.451802944 +0000 UTC m=+10.307722889" Jun 02 15:23:54.452339 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.452321 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-v4cd6"] Jun 02 15:23:54.456454 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.456432 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.456536 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.456500 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:23:54.531378 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.531340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.531561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.531438 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-kubelet-config\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.531561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.531471 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-dbus\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.616650 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.616569 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:54.616795 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.616670 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:54.617232 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.617214 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:54.617341 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.617313 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:54.631966 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.631938 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-dbus\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.632092 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.632009 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.632092 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.632059 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-kubelet-config\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.632202 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.632141 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-kubelet-config\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.632270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:54.632253 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-dbus\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:54.632457 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.632350 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:54.632457 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:54.632431 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret podName:d9ca7d05-8461-4cdf-b3a1-801e9041c6a3 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:55.132389736 +0000 UTC m=+10.988309672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret") pod "global-pull-secret-syncer-v4cd6" (UID: "d9ca7d05-8461-4cdf-b3a1-801e9041c6a3") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:55.135638 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:55.135599 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:55.135801 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:55.135736 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:55.135801 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:55.135793 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret podName:d9ca7d05-8461-4cdf-b3a1-801e9041c6a3 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:56.135779485 +0000 UTC m=+11.991699408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret") pod "global-pull-secret-syncer-v4cd6" (UID: "d9ca7d05-8461-4cdf-b3a1-801e9041c6a3") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:56.143826 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:56.143785 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:56.144289 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:56.143981 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:56.144289 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:56.144053 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret podName:d9ca7d05-8461-4cdf-b3a1-801e9041c6a3 nodeName:}" failed. No retries permitted until 2026-06-02 15:23:58.144033935 +0000 UTC m=+13.999953864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret") pod "global-pull-secret-syncer-v4cd6" (UID: "d9ca7d05-8461-4cdf-b3a1-801e9041c6a3") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:56.615786 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:56.615758 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:56.615983 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:56.615762 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:56.615983 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:56.615873 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:56.615983 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:56.615970 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:23:56.616134 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:56.615767 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:56.616134 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:56.616070 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:57.687495 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.687460 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerStarted","Data":"f61e087ab9aa4531aae54d1013ad2224b96022c7183a3ec3d2c69fb8a7527c35"} Jun 02 15:23:57.689633 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.689401 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5stt8" event={"ID":"3f4c1d9a-3383-4e2e-aef9-e5a586b47a08","Type":"ContainerStarted","Data":"86256d7363b301f6b1ebcfef411888a7a0fc79c412713dc61514c66755387542"} Jun 02 15:23:57.690939 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.690776 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2h25t" event={"ID":"17ace113-3104-4a14-a812-3ec1dcd632e4","Type":"ContainerStarted","Data":"2c518fde09993de6e1840fe895c5778b4313dadbdb13a5cee39f0755644637da"} Jun 02 15:23:57.692818 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.692407 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xch9g" event={"ID":"2b180344-0602-431e-b552-8e7144e52fd9","Type":"ContainerStarted","Data":"2406930add6c4cd8a440d47de56420116ed51ac278f7d076e5400ddf90552787"} Jun 02 15:23:57.694123 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.694102 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" event={"ID":"7808d353-cc9b-43cb-9257-8e023ae2837c","Type":"ContainerStarted","Data":"074fcbab9121d9ac4db76b7a002a708a9c9bcbe7538eee330dfd8c347c66eaff"} Jun 02 15:23:57.696171 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.695810 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-grt4p" event={"ID":"76a4adf4-a9b4-43fc-b264-7c089c010e79","Type":"ContainerStarted","Data":"ccae6bdea4f9f0643bf5c943900328bd5b6df4b36b22bd76ba15790733295494"} Jun 02 15:23:57.801568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.801062 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-grt4p" podStartSLOduration=3.865914874 podStartE2EDuration="13.801044378s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.432981334 +0000 UTC m=+3.288901258" lastFinishedPulling="2026-06-02 15:23:57.368110824 +0000 UTC m=+13.224030762" observedRunningTime="2026-06-02 15:23:57.765319009 +0000 UTC m=+13.621238955" watchObservedRunningTime="2026-06-02 15:23:57.801044378 +0000 UTC m=+13.656964324" Jun 02 15:23:57.801568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.801194 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xch9g" podStartSLOduration=3.853160287 podStartE2EDuration="13.801187489s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.424147209 +0000 UTC m=+3.280067148" lastFinishedPulling="2026-06-02 15:23:57.372174423 +0000 UTC m=+13.228094350" observedRunningTime="2026-06-02 15:23:57.800467327 +0000 UTC m=+13.656387278" watchObservedRunningTime="2026-06-02 15:23:57.801187489 +0000 UTC m=+13.657107437" Jun 02 15:23:57.875354 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.875210 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5stt8" podStartSLOduration=3.918670584 podStartE2EDuration="13.875196619s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.433719912 +0000 UTC m=+3.289639835" lastFinishedPulling="2026-06-02 15:23:57.390245942 +0000 UTC m=+13.246165870" observedRunningTime="2026-06-02 15:23:57.874973317 +0000 UTC m=+13.730893262" watchObservedRunningTime="2026-06-02 15:23:57.875196619 +0000 UTC m=+13.731116563" Jun 02 15:23:57.924903 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:57.924842 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2h25t" podStartSLOduration=3.983515993 podStartE2EDuration="13.924827598s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.426789873 +0000 UTC m=+3.282709810" lastFinishedPulling="2026-06-02 15:23:57.368101485 +0000 UTC m=+13.224021415" observedRunningTime="2026-06-02 15:23:57.924188412 +0000 UTC m=+13.780108358" watchObservedRunningTime="2026-06-02 15:23:57.924827598 +0000 UTC m=+13.780747545" Jun 02 15:23:58.161384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:58.161352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:58.161556 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:58.161536 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:58.161647 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:58.161632 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret podName:d9ca7d05-8461-4cdf-b3a1-801e9041c6a3 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:02.161608182 +0000 UTC m=+18.017528108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret") pod "global-pull-secret-syncer-v4cd6" (UID: "d9ca7d05-8461-4cdf-b3a1-801e9041c6a3") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:23:58.616573 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:58.616538 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:23:58.616756 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:58.616683 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:23:58.616756 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:58.616703 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:23:58.616869 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:58.616783 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:23:58.616869 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:58.616690 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:23:58.616869 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:23:58.616857 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:23:58.698973 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:58.698940 2567 generic.go:358] "Generic (PLEG): container finished" podID="426b4625-cbda-4bcd-b664-9a929fbf341f" containerID="f61e087ab9aa4531aae54d1013ad2224b96022c7183a3ec3d2c69fb8a7527c35" exitCode=0 Jun 02 15:23:58.699378 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:58.699050 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerDied","Data":"f61e087ab9aa4531aae54d1013ad2224b96022c7183a3ec3d2c69fb8a7527c35"} Jun 02 15:23:59.701866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:59.701828 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwq59" event={"ID":"082de97f-3812-4678-9c84-c47f8a51889b","Type":"ContainerStarted","Data":"c69b6b447ab5dfa99b7a897c557e344f7ed5feaf4dc285b6e042598632118199"} Jun 02 15:23:59.737171 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:23:59.737117 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwq59" podStartSLOduration=5.788718155 podStartE2EDuration="15.737098623s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.429796509 +0000 UTC m=+3.285716433" lastFinishedPulling="2026-06-02 15:23:57.378176967 +0000 UTC m=+13.234096901" observedRunningTime="2026-06-02 15:23:59.735292023 +0000 UTC m=+15.591211970" watchObservedRunningTime="2026-06-02 15:23:59.737098623 +0000 UTC m=+15.593018571" Jun 02 15:24:00.615775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:00.615738 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:00.615961 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:00.615850 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:00.615961 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:00.615862 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:00.616079 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:00.615975 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:00.616079 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:00.616021 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:00.616181 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:00.616097 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:00.621642 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:00.621619 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:24:00.622302 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:00.622280 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:24:01.739561 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:01.739527 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:24:01.739921 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:01.739643 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 15:24:01.740094 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:01.740079 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-grt4p" Jun 02 15:24:02.193216 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:02.193140 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:02.193370 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.193290 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:24:02.193370 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.193355 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret podName:d9ca7d05-8461-4cdf-b3a1-801e9041c6a3 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:10.193337362 +0000 UTC m=+26.049257291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret") pod "global-pull-secret-syncer-v4cd6" (UID: "d9ca7d05-8461-4cdf-b3a1-801e9041c6a3") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:24:02.395490 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:02.394819 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:02.395490 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:02.394871 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:02.395490 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.395068 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:24:02.395490 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.395089 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:24:02.395490 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.395104 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:02.395490 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.395159 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:24:18.395141479 +0000 UTC m=+34.251061403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:02.395920 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.395536 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:02.395920 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.395606 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:24:18.395587706 +0000 UTC m=+34.251507629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:02.615893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:02.615859 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:02.616053 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.615978 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:02.616332 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:02.616314 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:02.616450 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.616430 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:02.618802 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:02.618527 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:02.618802 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:02.618721 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:04.616939 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:04.616905 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:04.617429 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:04.616954 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:04.617429 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:04.616996 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:04.617429 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:04.617094 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:04.617429 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:04.617144 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:04.617429 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:04.617222 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:06.616285 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:06.616254 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:06.616285 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:06.616267 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:06.616285 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:06.616272 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:06.616874 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:06.616372 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:06.616874 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:06.616509 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:06.616874 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:06.616618 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:08.434301 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.434093 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 15:24:08.616052 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.616027 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:08.616160 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.616144 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:08.616199 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:08.616159 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:08.616261 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:08.616246 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:08.616307 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.616287 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:08.616356 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:08.616344 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:08.625821 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.625747 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T15:24:08.434299292Z","UUID":"2d833d38-dd6f-4e15-af9e-e5a68f0788eb","Handler":null,"Name":"","Endpoint":""} Jun 02 15:24:08.627174 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.627158 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 15:24:08.627266 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.627181 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 15:24:08.716681 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.716657 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrn4x" event={"ID":"92aeaf74-4c7f-41df-bcc5-4784e0130b1f","Type":"ContainerStarted","Data":"d620df829a8d63094000ff765174d875214d560b769d779d63a81e75ac74ca84"} Jun 02 15:24:08.720749 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.718963 2567 generic.go:358] "Generic (PLEG): container finished" podID="426b4625-cbda-4bcd-b664-9a929fbf341f" containerID="e19b69f69e53ff0c370bbecf4ffe6ddfe35e11a8b45f431ee8dc63b0e1d4d21e" exitCode=0 Jun 02 15:24:08.720749 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.719073 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerDied","Data":"e19b69f69e53ff0c370bbecf4ffe6ddfe35e11a8b45f431ee8dc63b0e1d4d21e"} Jun 02 15:24:08.721309 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.721285 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" event={"ID":"7808d353-cc9b-43cb-9257-8e023ae2837c","Type":"ContainerStarted","Data":"8b265b5232c391cdd0c7c3e1cc3682b60b6d19d8678230425caa6ae86f84cfd6"} Jun 02 15:24:08.723426 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.723391 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"40d330c05a2863d95a6216447f5d44403e092686713cd88aae9576e0415bc871"} Jun 02 15:24:08.723508 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.723435 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"9fcc7e83972a3814f04a18562eb96e95fa9c89b9214b07bbdbe14614efdd209f"} Jun 02 15:24:08.723508 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.723450 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"b2a6507febdc23723883a10e069f6d12db8a97bfc72d6a8e9841458a58936f9b"} Jun 02 15:24:08.723508 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.723461 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"8ef720bfd7e7c23ecee822933593e36565cf030862afee7a4803add327c8dd25"} Jun 02 15:24:08.825348 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:08.825252 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vrn4x" podStartSLOduration=5.478814834 podStartE2EDuration="24.825237868s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.431734731 +0000 UTC m=+3.287654654" lastFinishedPulling="2026-06-02 15:24:06.778157765 +0000 UTC m=+22.634077688" observedRunningTime="2026-06-02 15:24:08.750670182 +0000 UTC m=+24.606590126" watchObservedRunningTime="2026-06-02 15:24:08.825237868 +0000 UTC m=+24.681157812" Jun 02 15:24:09.727318 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:09.727239 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"c9707d4cc9b0d8324961f4001ccd64be92e070165d392553ba3d36b34cb0d296"} Jun 02 15:24:09.727318 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:09.727278 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"fb92dca8c28c29cec7a8a25e1caffcebfba336da8706af7cf57753ea6577280e"} Jun 02 15:24:10.258194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.258167 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:10.258311 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:10.258298 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 15:24:10.258361 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:10.258357 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret podName:d9ca7d05-8461-4cdf-b3a1-801e9041c6a3 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:26.258341549 +0000 UTC m=+42.114261472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret") pod "global-pull-secret-syncer-v4cd6" (UID: "d9ca7d05-8461-4cdf-b3a1-801e9041c6a3") : object "kube-system"/"original-pull-secret" not registered Jun 02 15:24:10.616128 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.616104 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:10.616128 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.616116 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:10.616314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.616116 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:10.616314 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:10.616190 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:10.616314 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:10.616267 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:10.616432 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:10.616333 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:10.730342 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.730311 2567 generic.go:358] "Generic (PLEG): container finished" podID="426b4625-cbda-4bcd-b664-9a929fbf341f" containerID="25566fee00528f3315cee329be90019188463a0c6dbae668c18df46ea0139063" exitCode=0 Jun 02 15:24:10.730778 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.730381 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerDied","Data":"25566fee00528f3315cee329be90019188463a0c6dbae668c18df46ea0139063"} Jun 02 15:24:10.732324 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.732302 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" event={"ID":"7808d353-cc9b-43cb-9257-8e023ae2837c","Type":"ContainerStarted","Data":"e24c9043ff731c348651c003432050e5ca2b801248b6d01994e24c6874b18609"} Jun 02 15:24:10.813857 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:10.813805 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ltgdr" podStartSLOduration=4.417115493 podStartE2EDuration="26.813793536s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.426533461 +0000 UTC m=+3.282453385" lastFinishedPulling="2026-06-02 15:24:09.823211504 +0000 UTC m=+25.679131428" observedRunningTime="2026-06-02 15:24:10.813602792 +0000 UTC m=+26.669522737" watchObservedRunningTime="2026-06-02 15:24:10.813793536 +0000 UTC m=+26.669713482" Jun 02 15:24:11.736752 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:11.736713 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"d6a94ad1a0cf86f4388785545da4c9cf73bbe5e67f84e6af38dc5f9b8061a4f0"} Jun 02 15:24:12.615751 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:12.615723 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:12.615913 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:12.615775 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:12.615913 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:12.615857 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:12.616047 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:12.615923 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:12.616047 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:12.615960 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:12.616135 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:12.616060 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:12.740772 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:12.740745 2567 generic.go:358] "Generic (PLEG): container finished" podID="426b4625-cbda-4bcd-b664-9a929fbf341f" containerID="cc7615ce401cc20cd3f2dc5ff323e7f4ade6bcf928903c99e19722617a6d3ac2" exitCode=0 Jun 02 15:24:12.741155 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:12.740787 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerDied","Data":"cc7615ce401cc20cd3f2dc5ff323e7f4ade6bcf928903c99e19722617a6d3ac2"} Jun 02 15:24:13.746160 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:13.746123 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" event={"ID":"b11358fd-dc75-4117-98a5-69be726c6687","Type":"ContainerStarted","Data":"3f6eb37266ad5433734b4a79342cac556e3f65114e38db99c064b8da26900263"} Jun 02 15:24:13.746620 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:13.746424 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:24:13.746620 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:13.746440 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:24:13.762296 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:13.762271 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:24:13.847702 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:13.847643 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" podStartSLOduration=8.951568206 podStartE2EDuration="29.847625629s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.423584592 +0000 UTC m=+3.279504516" lastFinishedPulling="2026-06-02 15:24:08.319641999 +0000 UTC m=+24.175561939" observedRunningTime="2026-06-02 15:24:13.790962824 +0000 UTC m=+29.646882770" watchObservedRunningTime="2026-06-02 15:24:13.847625629 +0000 UTC m=+29.703545578" Jun 02 15:24:14.618713 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:14.618682 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:14.618894 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:14.618725 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:14.618894 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:14.618681 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:14.618894 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:14.618796 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:14.619040 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:14.618903 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:14.619040 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:14.618975 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:14.748340 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:14.748304 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:24:14.765874 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:14.765843 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:24:15.431147 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:15.430905 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4cd6"] Jun 02 15:24:15.431317 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:15.431254 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:15.431380 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:15.431362 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:15.441598 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:15.441317 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-db66h"] Jun 02 15:24:15.441598 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:15.441445 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:15.441598 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:15.441530 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:15.479730 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:15.479706 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhfj8"] Jun 02 15:24:15.479855 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:15.479805 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:15.479915 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:15.479880 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:16.615749 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:16.615714 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:16.615749 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:16.615734 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:16.616156 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:16.615824 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:16.616156 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:16.615963 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:17.616624 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:17.616594 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:17.617105 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:17.616916 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:18.421312 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:18.421276 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:18.421513 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:18.421331 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:18.421513 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.421458 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:18.421632 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.421515 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 15:24:18.421632 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.421533 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 15:24:18.421632 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.421538 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:24:50.421514559 +0000 UTC m=+66.277434508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 15:24:18.421632 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.421546 2567 projected.go:194] Error preparing data for projected volume kube-api-access-qjjr9 for pod openshift-network-diagnostics/network-check-target-nhfj8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:18.421632 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.421597 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9 podName:e25bfd83-d685-46c4-af12-77b69c2facbd nodeName:}" failed. No retries permitted until 2026-06-02 15:24:50.421581336 +0000 UTC m=+66.277501265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjjr9" (UniqueName: "kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9") pod "network-check-target-nhfj8" (UID: "e25bfd83-d685-46c4-af12-77b69c2facbd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 15:24:18.615720 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:18.615686 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:18.615720 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:18.615710 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:18.615936 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.615812 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:18.615989 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:18.615952 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:19.615706 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:19.615667 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:19.616222 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:19.615788 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4cd6" podUID="d9ca7d05-8461-4cdf-b3a1-801e9041c6a3" Jun 02 15:24:19.759970 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:19.759941 2567 generic.go:358] "Generic (PLEG): container finished" podID="426b4625-cbda-4bcd-b664-9a929fbf341f" containerID="fe1e4ec4daa1e2c616013b9906e2721d91a5aad23f79aa7a3994e4f76cc13566" exitCode=0 Jun 02 15:24:19.760144 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:19.759997 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerDied","Data":"fe1e4ec4daa1e2c616013b9906e2721d91a5aad23f79aa7a3994e4f76cc13566"} Jun 02 15:24:20.616112 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:20.616083 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:20.616664 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:20.616091 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:20.616664 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:20.616228 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhfj8" podUID="e25bfd83-d685-46c4-af12-77b69c2facbd" Jun 02 15:24:20.616664 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:20.616340 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:24:20.763977 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:20.763948 2567 generic.go:358] "Generic (PLEG): container finished" podID="426b4625-cbda-4bcd-b664-9a929fbf341f" containerID="401b008af19e35a3074abfd5bf5507ba23aa8639e65aa5e857ef38fc470bb59b" exitCode=0 Jun 02 15:24:20.764082 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:20.764006 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerDied","Data":"401b008af19e35a3074abfd5bf5507ba23aa8639e65aa5e857ef38fc470bb59b"} Jun 02 15:24:21.009539 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.009350 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-206.ec2.internal" event="NodeReady" Jun 02 15:24:21.009677 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.009611 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 15:24:21.088041 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.088014 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gzlx7"] Jun 02 15:24:21.090388 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.090363 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.090731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.090707 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-484fv"] Jun 02 15:24:21.092796 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.092777 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.097601 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.097584 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 15:24:21.097778 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.097766 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqlt7\"" Jun 02 15:24:21.097830 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.097806 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 15:24:21.098221 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.098202 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 15:24:21.098361 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.098346 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 15:24:21.099753 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.099556 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 15:24:21.099842 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.099823 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb47d\"" Jun 02 15:24:21.127770 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.127749 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gzlx7"] Jun 02 15:24:21.128547 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.128526 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-484fv"] Jun 02 15:24:21.245535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.245496 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zr75\" (UniqueName: \"kubernetes.io/projected/49ac80c2-2ef3-4019-bf29-6516f3add356-kube-api-access-8zr75\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.245680 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.245548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.245680 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.245581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.245680 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.245610 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79d97372-9182-4b0d-9250-2d2cd6383c4f-config-volume\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.245680 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.245657 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d97372-9182-4b0d-9250-2d2cd6383c4f-tmp-dir\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.245835 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.245686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s4rw\" (UniqueName: \"kubernetes.io/projected/79d97372-9182-4b0d-9250-2d2cd6383c4f-kube-api-access-8s4rw\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.346871 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.346811 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8zr75\" (UniqueName: \"kubernetes.io/projected/49ac80c2-2ef3-4019-bf29-6516f3add356-kube-api-access-8zr75\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.346871 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.346839 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.346871 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.346862 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.346882 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79d97372-9182-4b0d-9250-2d2cd6383c4f-config-volume\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.346902 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d97372-9182-4b0d-9250-2d2cd6383c4f-tmp-dir\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.346916 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8s4rw\" (UniqueName: \"kubernetes.io/projected/79d97372-9182-4b0d-9250-2d2cd6383c4f-kube-api-access-8s4rw\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.346979 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.346983 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.347043 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:21.847025039 +0000 UTC m=+37.702944961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:21.347073 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.347059 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:21.847051408 +0000 UTC m=+37.702971330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:21.347337 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.347266 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d97372-9182-4b0d-9250-2d2cd6383c4f-tmp-dir\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.347519 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.347499 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79d97372-9182-4b0d-9250-2d2cd6383c4f-config-volume\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.365028 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.365005 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s4rw\" (UniqueName: \"kubernetes.io/projected/79d97372-9182-4b0d-9250-2d2cd6383c4f-kube-api-access-8s4rw\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.365028 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.365019 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zr75\" (UniqueName: \"kubernetes.io/projected/49ac80c2-2ef3-4019-bf29-6516f3add356-kube-api-access-8zr75\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.615834 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.615753 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:21.622808 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.622789 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 15:24:21.768580 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.768545 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k97rk" event={"ID":"426b4625-cbda-4bcd-b664-9a929fbf341f","Type":"ContainerStarted","Data":"270a515d52bd9f09682960650c8af5a612b93251c43068692a93ee0042fc17d9"} Jun 02 15:24:21.851149 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.851120 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:21.851286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:21.851157 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:21.851286 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.851249 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:21.851286 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.851252 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:21.851384 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.851297 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:22.851283685 +0000 UTC m=+38.707203608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:21.851384 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:21.851309 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:22.851303322 +0000 UTC m=+38.707223245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:22.615827 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.615794 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:22.616033 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.615995 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:22.625767 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.625745 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:24:22.626068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.625751 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:24:22.626127 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.626112 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:24:22.626174 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.626137 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hhkk\"" Jun 02 15:24:22.626174 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.626159 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8csp4\"" Jun 02 15:24:22.857050 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.857020 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:22.857223 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:22.857068 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:22.857223 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:22.857149 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:22.857223 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:22.857217 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:24.857194684 +0000 UTC m=+40.713114607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:22.857374 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:22.857239 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:22.857374 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:22.857299 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:24.857282435 +0000 UTC m=+40.713202361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:24.869436 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:24.869383 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:24.869841 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:24.869445 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:24.869841 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:24.869518 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:24.869841 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:24.869572 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:24.869841 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:24.869579 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:28.869563233 +0000 UTC m=+44.725483156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:24.869841 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:24.869622 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:28.869604929 +0000 UTC m=+44.725524865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:26.280253 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:26.280216 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:26.282902 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:26.282883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d9ca7d05-8461-4cdf-b3a1-801e9041c6a3-original-pull-secret\") pod \"global-pull-secret-syncer-v4cd6\" (UID: \"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3\") " pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:26.424722 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:26.424685 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4cd6" Jun 02 15:24:26.574995 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:26.574895 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k97rk" podStartSLOduration=10.834608226 podStartE2EDuration="42.574873628s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:23:47.430985491 +0000 UTC m=+3.286905430" lastFinishedPulling="2026-06-02 15:24:19.171250909 +0000 UTC m=+35.027170832" observedRunningTime="2026-06-02 15:24:21.807936471 +0000 UTC m=+37.663856413" watchObservedRunningTime="2026-06-02 15:24:26.574873628 +0000 UTC m=+42.430793574" Jun 02 15:24:26.575139 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:26.575111 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4cd6"] Jun 02 15:24:26.579490 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:24:26.579452 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9ca7d05_8461_4cdf_b3a1_801e9041c6a3.slice/crio-a128b0107579d18a735df42d2b28084fbc90e6da37abd31a709ce4c94ad61af8 WatchSource:0}: Error finding container a128b0107579d18a735df42d2b28084fbc90e6da37abd31a709ce4c94ad61af8: Status 404 returned error can't find the container with id a128b0107579d18a735df42d2b28084fbc90e6da37abd31a709ce4c94ad61af8 Jun 02 15:24:26.778501 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:26.778472 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4cd6" event={"ID":"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3","Type":"ContainerStarted","Data":"a128b0107579d18a735df42d2b28084fbc90e6da37abd31a709ce4c94ad61af8"} Jun 02 15:24:28.896496 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:28.896271 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:28.896934 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:28.896533 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:28.896934 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:28.896457 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:28.896934 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:28.896665 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:36.896642114 +0000 UTC m=+52.752562047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:28.896934 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:28.896711 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:28.896934 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:28.896783 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:36.896766228 +0000 UTC m=+52.752686156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:30.789598 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:30.789561 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4cd6" event={"ID":"d9ca7d05-8461-4cdf-b3a1-801e9041c6a3","Type":"ContainerStarted","Data":"ce1fe217f3b4ce3b1e803cf910fb681dfaa41adaa525f2c4df4b45ec73a6c15a"} Jun 02 15:24:30.814432 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:30.814351 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v4cd6" podStartSLOduration=33.083802427 podStartE2EDuration="36.81433718s" podCreationTimestamp="2026-06-02 15:23:54 +0000 UTC" firstStartedPulling="2026-06-02 15:24:26.5811473 +0000 UTC m=+42.437067223" lastFinishedPulling="2026-06-02 15:24:30.311682052 +0000 UTC m=+46.167601976" observedRunningTime="2026-06-02 15:24:30.813000462 +0000 UTC m=+46.668920408" watchObservedRunningTime="2026-06-02 15:24:30.81433718 +0000 UTC m=+46.670257125" Jun 02 15:24:36.954663 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:36.954628 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:36.954663 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:36.954669 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:36.955139 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:36.954786 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:36.955139 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:36.954786 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:36.955139 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:36.954850 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:24:52.954835395 +0000 UTC m=+68.810755317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:36.955139 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:36.954864 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:24:52.954858787 +0000 UTC m=+68.810778710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:46.762457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:46.762408 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vsst" Jun 02 15:24:50.442445 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.442392 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:24:50.442876 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.442450 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:50.445189 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.445170 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 15:24:50.445237 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.445208 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 15:24:50.452938 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:50.452918 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:24:50.453018 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:50.452982 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:25:54.452964103 +0000 UTC m=+130.308884025 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : secret "metrics-daemon-secret" not found Jun 02 15:24:50.456401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.456383 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 15:24:50.467138 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.467118 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjjr9\" (UniqueName: \"kubernetes.io/projected/e25bfd83-d685-46c4-af12-77b69c2facbd-kube-api-access-qjjr9\") pod \"network-check-target-nhfj8\" (UID: \"e25bfd83-d685-46c4-af12-77b69c2facbd\") " pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:50.530682 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.530658 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6hhkk\"" Jun 02 15:24:50.538746 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.538727 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:50.659384 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.659355 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhfj8"] Jun 02 15:24:50.662642 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:24:50.662613 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25bfd83_d685_46c4_af12_77b69c2facbd.slice/crio-90a9f9cb5af8cf7e1624d5ba78b8bfa70cd32c901e207e5a4e4fc90826f631e1 WatchSource:0}: Error finding container 90a9f9cb5af8cf7e1624d5ba78b8bfa70cd32c901e207e5a4e4fc90826f631e1: Status 404 returned error can't find the container with id 90a9f9cb5af8cf7e1624d5ba78b8bfa70cd32c901e207e5a4e4fc90826f631e1 Jun 02 15:24:50.824684 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:50.824648 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhfj8" event={"ID":"e25bfd83-d685-46c4-af12-77b69c2facbd","Type":"ContainerStarted","Data":"90a9f9cb5af8cf7e1624d5ba78b8bfa70cd32c901e207e5a4e4fc90826f631e1"} Jun 02 15:24:52.960797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:52.960660 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:24:52.960797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:52.960701 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:24:52.961246 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:52.960823 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:24:52.961246 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:52.960833 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:24:52.961246 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:52.960875 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:25:24.960858614 +0000 UTC m=+100.816778554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:24:52.961246 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:24:52.960890 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:25:24.960884176 +0000 UTC m=+100.816804100 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:24:53.831892 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:53.831858 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhfj8" event={"ID":"e25bfd83-d685-46c4-af12-77b69c2facbd","Type":"ContainerStarted","Data":"024fd7c14172da86d8b15f0cd3a8e12190d532cf2fa992b8c3a6eaf835f076dd"} Jun 02 15:24:53.832029 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:53.831968 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:24:53.850545 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:24:53.850504 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nhfj8" podStartSLOduration=66.836085922 podStartE2EDuration="1m9.850491466s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:24:50.664398205 +0000 UTC m=+66.520318128" lastFinishedPulling="2026-06-02 15:24:53.678803741 +0000 UTC m=+69.534723672" observedRunningTime="2026-06-02 15:24:53.850217845 +0000 UTC m=+69.706137790" watchObservedRunningTime="2026-06-02 15:24:53.850491466 +0000 UTC m=+69.706411410" Jun 02 15:25:24.836134 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:25:24.836106 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nhfj8" Jun 02 15:25:24.968357 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:25:24.968327 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:25:24.968357 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:25:24.968356 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:25:24.968571 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:25:24.968468 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 15:25:24.968571 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:25:24.968471 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 15:25:24.968571 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:25:24.968525 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert podName:49ac80c2-2ef3-4019-bf29-6516f3add356 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:28.968505466 +0000 UTC m=+164.824425396 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert") pod "ingress-canary-484fv" (UID: "49ac80c2-2ef3-4019-bf29-6516f3add356") : secret "canary-serving-cert" not found Jun 02 15:25:24.968571 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:25:24.968539 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls podName:79d97372-9182-4b0d-9250-2d2cd6383c4f nodeName:}" failed. No retries permitted until 2026-06-02 15:26:28.968532502 +0000 UTC m=+164.824452424 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls") pod "dns-default-gzlx7" (UID: "79d97372-9182-4b0d-9250-2d2cd6383c4f") : secret "dns-default-metrics-tls" not found Jun 02 15:25:54.461526 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:25:54.461474 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:25:54.461993 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:25:54.461623 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 15:25:54.461993 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:25:54.461695 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs podName:828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba nodeName:}" failed. No retries permitted until 2026-06-02 15:27:56.461678357 +0000 UTC m=+252.317598284 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs") pod "network-metrics-daemon-db66h" (UID: "828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba") : secret "metrics-daemon-secret" not found Jun 02 15:26:02.376548 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.376516 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr"] Jun 02 15:26:02.379236 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.379222 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" Jun 02 15:26:02.381714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.381696 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rr76r\"" Jun 02 15:26:02.392199 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.392167 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr"] Jun 02 15:26:02.513822 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.513784 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbjg\" (UniqueName: \"kubernetes.io/projected/1ebff8e6-3fc7-41c5-a656-810aec790edb-kube-api-access-7dbjg\") pod \"network-check-source-56d84b9f44-4lqqr\" (UID: \"1ebff8e6-3fc7-41c5-a656-810aec790edb\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" Jun 02 15:26:02.614828 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.614798 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbjg\" (UniqueName: \"kubernetes.io/projected/1ebff8e6-3fc7-41c5-a656-810aec790edb-kube-api-access-7dbjg\") pod \"network-check-source-56d84b9f44-4lqqr\" (UID: \"1ebff8e6-3fc7-41c5-a656-810aec790edb\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" Jun 02 15:26:02.635679 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.635621 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbjg\" (UniqueName: \"kubernetes.io/projected/1ebff8e6-3fc7-41c5-a656-810aec790edb-kube-api-access-7dbjg\") pod \"network-check-source-56d84b9f44-4lqqr\" (UID: \"1ebff8e6-3fc7-41c5-a656-810aec790edb\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" Jun 02 15:26:02.672041 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.672012 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f"] Jun 02 15:26:02.674812 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.674798 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.681696 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.681676 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h"] Jun 02 15:26:02.682981 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.682959 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gw5mt\"" Jun 02 15:26:02.683072 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.683024 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.683072 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.683057 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 15:26:02.684467 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.684452 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f6b7fc679-7x44m"] Jun 02 15:26:02.684616 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.684599 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.685014 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.684998 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 15:26:02.685817 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.685792 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.687231 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.687216 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.689941 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.689926 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" Jun 02 15:26:02.690983 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.690628 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.691150 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.691066 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.691270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.691252 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 15:26:02.691372 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.691342 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 15:26:02.691720 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.691705 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 15:26:02.691932 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.691736 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-hhm2r\"" Jun 02 15:26:02.692313 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.692296 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.692465 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.692446 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 15:26:02.692579 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.692468 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 15:26:02.692579 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.692502 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.693118 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.693102 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 15:26:02.693995 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.693977 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g2mx7\"" Jun 02 15:26:02.708119 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.708098 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f"] Jun 02 15:26:02.717663 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.717635 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f6b7fc679-7x44m"] Jun 02 15:26:02.718227 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.718210 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h"] Jun 02 15:26:02.739378 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.739311 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt"] Jun 02 15:26:02.743401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.743380 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.745753 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.745732 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 15:26:02.746135 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.746116 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 15:26:02.746867 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.746846 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 15:26:02.751037 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.750972 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w6jsj\"" Jun 02 15:26:02.758030 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.758009 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 15:26:02.781666 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.781601 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt"] Jun 02 15:26:02.815904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.815877 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8knv6\" (UniqueName: \"kubernetes.io/projected/a886587d-a56b-47e1-9a01-db002a40d171-kube-api-access-8knv6\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.816059 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.815929 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.816059 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.815957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.816059 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.815996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a2e454c-1d56-423a-a325-6f02ce1c9e85-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.816059 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816041 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a886587d-a56b-47e1-9a01-db002a40d171-config\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816065 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816098 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816129 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a886587d-a56b-47e1-9a01-db002a40d171-serving-cert\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816153 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-stats-auth\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2vgf\" (UniqueName: \"kubernetes.io/projected/4a2e454c-1d56-423a-a325-6f02ce1c9e85-kube-api-access-s2vgf\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816209 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8p2\" (UniqueName: \"kubernetes.io/projected/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-kube-api-access-cf8p2\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.816276 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816255 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-default-certificate\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.816575 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816283 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.816575 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.816316 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pc2j\" (UniqueName: \"kubernetes.io/projected/28929637-9b6e-436a-8eea-7d4cce493b5b-kube-api-access-2pc2j\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.821098 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.821075 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr"] Jun 02 15:26:02.824352 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:02.824329 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ebff8e6_3fc7_41c5_a656_810aec790edb.slice/crio-951bf1caa38192b71178d43d5bbd4c1b6a19d126333630b5d538f0f6b5bbc4c2 WatchSource:0}: Error finding container 951bf1caa38192b71178d43d5bbd4c1b6a19d126333630b5d538f0f6b5bbc4c2: Status 404 returned error can't find the container with id 951bf1caa38192b71178d43d5bbd4c1b6a19d126333630b5d538f0f6b5bbc4c2 Jun 02 15:26:02.917144 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917082 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a886587d-a56b-47e1-9a01-db002a40d171-config\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.917144 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917115 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.917328 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917146 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.917328 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917176 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a886587d-a56b-47e1-9a01-db002a40d171-serving-cert\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.917328 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917198 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-stats-auth\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.917328 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917226 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2vgf\" (UniqueName: \"kubernetes.io/projected/4a2e454c-1d56-423a-a325-6f02ce1c9e85-kube-api-access-s2vgf\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.917614 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:02.917341 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:26:02.917614 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:02.917437 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:03.417392801 +0000 UTC m=+139.273312726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : secret "router-metrics-certs-default" not found Jun 02 15:26:02.917761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917611 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8p2\" (UniqueName: \"kubernetes.io/projected/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-kube-api-access-cf8p2\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.917761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917653 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-default-certificate\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.917761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917680 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.917761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917694 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a886587d-a56b-47e1-9a01-db002a40d171-config\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.917761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917704 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pc2j\" (UniqueName: \"kubernetes.io/projected/28929637-9b6e-436a-8eea-7d4cce493b5b-kube-api-access-2pc2j\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.917761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917761 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8knv6\" (UniqueName: \"kubernetes.io/projected/a886587d-a56b-47e1-9a01-db002a40d171-kube-api-access-8knv6\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.918208 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917839 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.918208 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917865 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.918208 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.917905 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a2e454c-1d56-423a-a325-6f02ce1c9e85-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.918208 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:02.917937 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:03.417914279 +0000 UTC m=+139.273834213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : configmap references non-existent config key: service-ca.crt Jun 02 15:26:02.918540 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:02.918351 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:02.918540 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:02.918407 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls podName:4a2e454c-1d56-423a-a325-6f02ce1c9e85 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:03.418390527 +0000 UTC m=+139.274310454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-fjm8h" (UID: "4a2e454c-1d56-423a-a325-6f02ce1c9e85") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:02.918827 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.918804 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4a2e454c-1d56-423a-a325-6f02ce1c9e85-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.918910 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.918821 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.920088 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.920064 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.920192 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.920171 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a886587d-a56b-47e1-9a01-db002a40d171-serving-cert\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.920260 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.920245 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-stats-auth\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.920295 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.920261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-default-certificate\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.925323 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.925306 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2vgf\" (UniqueName: \"kubernetes.io/projected/4a2e454c-1d56-423a-a325-6f02ce1c9e85-kube-api-access-s2vgf\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:02.930240 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.930220 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8knv6\" (UniqueName: \"kubernetes.io/projected/a886587d-a56b-47e1-9a01-db002a40d171-kube-api-access-8knv6\") pod \"service-ca-operator-69877444c-6bn2f\" (UID: \"a886587d-a56b-47e1-9a01-db002a40d171\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:02.932053 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.932030 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8p2\" (UniqueName: \"kubernetes.io/projected/7d23b6c7-b5c5-479b-a27a-14fc6685b3ee-kube-api-access-cf8p2\") pod \"kube-storage-version-migrator-operator-96ddc787c-clgzt\" (UID: \"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:02.932635 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.932615 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pc2j\" (UniqueName: \"kubernetes.io/projected/28929637-9b6e-436a-8eea-7d4cce493b5b-kube-api-access-2pc2j\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:02.958695 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.958669 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" event={"ID":"1ebff8e6-3fc7-41c5-a656-810aec790edb","Type":"ContainerStarted","Data":"dfe1a29c0530aabb9f14d5abd9b0e63c317eae2b2937da346322be3b8ce5ff37"} Jun 02 15:26:02.958798 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.958702 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" event={"ID":"1ebff8e6-3fc7-41c5-a656-810aec790edb","Type":"ContainerStarted","Data":"951bf1caa38192b71178d43d5bbd4c1b6a19d126333630b5d538f0f6b5bbc4c2"} Jun 02 15:26:02.976876 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.976841 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-4lqqr" podStartSLOduration=0.976830915 podStartE2EDuration="976.830915ms" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:02.975197643 +0000 UTC m=+138.831117587" watchObservedRunningTime="2026-06-02 15:26:02.976830915 +0000 UTC m=+138.832750860" Jun 02 15:26:02.983779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:02.983758 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" Jun 02 15:26:03.056029 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.055988 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" Jun 02 15:26:03.114946 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.114812 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f"] Jun 02 15:26:03.117489 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:03.117383 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda886587d_a56b_47e1_9a01_db002a40d171.slice/crio-e44dcc501e494d062262e38beb39e0dd2d3873d59fa041260ad3eade7e304865 WatchSource:0}: Error finding container e44dcc501e494d062262e38beb39e0dd2d3873d59fa041260ad3eade7e304865: Status 404 returned error can't find the container with id e44dcc501e494d062262e38beb39e0dd2d3873d59fa041260ad3eade7e304865 Jun 02 15:26:03.180697 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.180638 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt"] Jun 02 15:26:03.183881 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:03.183857 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d23b6c7_b5c5_479b_a27a_14fc6685b3ee.slice/crio-4c7bc507e7f7843e1c3e164cd72c5579c1f9eb21997bc3e41351baf837c5ad91 WatchSource:0}: Error finding container 4c7bc507e7f7843e1c3e164cd72c5579c1f9eb21997bc3e41351baf837c5ad91: Status 404 returned error can't find the container with id 4c7bc507e7f7843e1c3e164cd72c5579c1f9eb21997bc3e41351baf837c5ad91 Jun 02 15:26:03.421950 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.421911 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.421969 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.421995 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:03.422102 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:03.422114 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:03.422154 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:04.422138829 +0000 UTC m=+140.278058752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : secret "router-metrics-certs-default" not found Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:03.422179 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:04.422161776 +0000 UTC m=+140.278081699 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : configmap references non-existent config key: service-ca.crt Jun 02 15:26:03.422395 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:03.422200 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls podName:4a2e454c-1d56-423a-a325-6f02ce1c9e85 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:04.422193096 +0000 UTC m=+140.278113019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-fjm8h" (UID: "4a2e454c-1d56-423a-a325-6f02ce1c9e85") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:03.962514 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.962369 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" event={"ID":"a886587d-a56b-47e1-9a01-db002a40d171","Type":"ContainerStarted","Data":"e44dcc501e494d062262e38beb39e0dd2d3873d59fa041260ad3eade7e304865"} Jun 02 15:26:03.963807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:03.963760 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" event={"ID":"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee","Type":"ContainerStarted","Data":"4c7bc507e7f7843e1c3e164cd72c5579c1f9eb21997bc3e41351baf837c5ad91"} Jun 02 15:26:04.433104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:04.433064 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:04.433152 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:04.433199 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:04.433212 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:04.433274 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls podName:4a2e454c-1d56-423a-a325-6f02ce1c9e85 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:06.433259478 +0000 UTC m=+142.289179401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-fjm8h" (UID: "4a2e454c-1d56-423a-a325-6f02ce1c9e85") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:04.433284 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:04.433343 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:06.433330546 +0000 UTC m=+142.289250468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : secret "router-metrics-certs-default" not found Jun 02 15:26:04.433562 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:04.433357 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:06.433350601 +0000 UTC m=+142.289270524 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : configmap references non-existent config key: service-ca.crt Jun 02 15:26:05.969256 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:05.969175 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" event={"ID":"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee","Type":"ContainerStarted","Data":"f3618c8fc6d77c47b2d0b1189457e97193a3d030fefea8befc628b65ab6d36c0"} Jun 02 15:26:05.970588 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:05.970563 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" event={"ID":"a886587d-a56b-47e1-9a01-db002a40d171","Type":"ContainerStarted","Data":"0868e7bdc27f8d3143f09046f0e53c959284cede31e34a3eaaf4967708491f5b"} Jun 02 15:26:05.985916 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:05.985873 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" podStartSLOduration=1.50583315 podStartE2EDuration="3.985854646s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:03.186090335 +0000 UTC m=+139.042010259" lastFinishedPulling="2026-06-02 15:26:05.666111833 +0000 UTC m=+141.522031755" observedRunningTime="2026-06-02 15:26:05.985254826 +0000 UTC m=+141.841174770" watchObservedRunningTime="2026-06-02 15:26:05.985854646 +0000 UTC m=+141.841774592" Jun 02 15:26:06.001685 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:06.001646 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" podStartSLOduration=1.457438048 podStartE2EDuration="4.001634164s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:03.119571246 +0000 UTC m=+138.975491170" lastFinishedPulling="2026-06-02 15:26:05.66376736 +0000 UTC m=+141.519687286" observedRunningTime="2026-06-02 15:26:06.000937913 +0000 UTC m=+141.856857858" watchObservedRunningTime="2026-06-02 15:26:06.001634164 +0000 UTC m=+141.857554122" Jun 02 15:26:06.447619 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:06.447580 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:06.447786 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:06.447642 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:06.447786 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:06.447703 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:06.447786 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:06.447716 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:26:06.447786 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:06.447775 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:10.447760871 +0000 UTC m=+146.303680795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : secret "router-metrics-certs-default" not found Jun 02 15:26:06.447943 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:06.447791 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:06.447943 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:06.447825 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:10.447804861 +0000 UTC m=+146.303724787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : configmap references non-existent config key: service-ca.crt Jun 02 15:26:06.447943 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:06.447889 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls podName:4a2e454c-1d56-423a-a325-6f02ce1c9e85 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:10.447877498 +0000 UTC m=+146.303797426 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-fjm8h" (UID: "4a2e454c-1d56-423a-a325-6f02ce1c9e85") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:08.558381 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:08.558354 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2h25t_17ace113-3104-4a14-a812-3ec1dcd632e4/dns-node-resolver/0.log" Jun 02 15:26:09.758787 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.758759 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xch9g_2b180344-0602-431e-b552-8e7144e52fd9/node-ca/0.log" Jun 02 15:26:09.928847 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.928817 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-g25s7"] Jun 02 15:26:09.932824 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.932805 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:09.935031 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.935009 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 15:26:09.935715 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.935694 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 15:26:09.935831 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.935693 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n4lrv\"" Jun 02 15:26:09.935831 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.935774 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 15:26:09.935831 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.935799 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 15:26:09.940884 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:09.940866 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-g25s7"] Jun 02 15:26:10.076607 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.076543 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-signing-key\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.076607 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.076579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-signing-cabundle\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.076737 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.076650 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzsqs\" (UniqueName: \"kubernetes.io/projected/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-kube-api-access-xzsqs\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.177300 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.177271 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-signing-key\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.177468 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.177308 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-signing-cabundle\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.177532 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.177471 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xzsqs\" (UniqueName: \"kubernetes.io/projected/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-kube-api-access-xzsqs\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.177924 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.177906 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-signing-cabundle\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.179835 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.179816 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-signing-key\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.185753 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.185736 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzsqs\" (UniqueName: \"kubernetes.io/projected/a38b2cc1-3b39-497f-bcc0-0781ae0c7d90-kube-api-access-xzsqs\") pod \"service-ca-685df94d57-g25s7\" (UID: \"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90\") " pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.241898 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.241875 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-g25s7" Jun 02 15:26:10.361540 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.361432 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-g25s7"] Jun 02 15:26:10.364367 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:10.364337 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38b2cc1_3b39_497f_bcc0_0781ae0c7d90.slice/crio-9a63d0c9d484203af495ce559947994a4e50d055d53b4449a5c4dce3eb89d93a WatchSource:0}: Error finding container 9a63d0c9d484203af495ce559947994a4e50d055d53b4449a5c4dce3eb89d93a: Status 404 returned error can't find the container with id 9a63d0c9d484203af495ce559947994a4e50d055d53b4449a5c4dce3eb89d93a Jun 02 15:26:10.480815 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.480776 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:10.481032 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.480838 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:10.481032 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.480886 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:10.481032 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:10.480953 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:18.480929617 +0000 UTC m=+154.336849545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : configmap references non-existent config key: service-ca.crt Jun 02 15:26:10.481032 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:10.480989 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:10.481032 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:10.481036 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls podName:4a2e454c-1d56-423a-a325-6f02ce1c9e85 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:18.481025551 +0000 UTC m=+154.336945473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-fjm8h" (UID: "4a2e454c-1d56-423a-a325-6f02ce1c9e85") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:10.481309 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:10.480989 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 15:26:10.481309 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:10.481074 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs podName:28929637-9b6e-436a-8eea-7d4cce493b5b nodeName:}" failed. No retries permitted until 2026-06-02 15:26:18.481065192 +0000 UTC m=+154.336985115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs") pod "router-default-7f6b7fc679-7x44m" (UID: "28929637-9b6e-436a-8eea-7d4cce493b5b") : secret "router-metrics-certs-default" not found Jun 02 15:26:10.982580 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.982544 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-g25s7" event={"ID":"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90","Type":"ContainerStarted","Data":"21e241a660963ceb1905b806be820821443d38599ee1dfa9253c823626f153b1"} Jun 02 15:26:10.982580 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:10.982582 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-g25s7" event={"ID":"a38b2cc1-3b39-497f-bcc0-0781ae0c7d90","Type":"ContainerStarted","Data":"9a63d0c9d484203af495ce559947994a4e50d055d53b4449a5c4dce3eb89d93a"} Jun 02 15:26:11.001690 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:11.001645 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-g25s7" podStartSLOduration=2.001630111 podStartE2EDuration="2.001630111s" podCreationTimestamp="2026-06-02 15:26:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:10.99998382 +0000 UTC m=+146.855903763" watchObservedRunningTime="2026-06-02 15:26:11.001630111 +0000 UTC m=+146.857550066" Jun 02 15:26:18.545676 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.545637 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:18.546079 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.545700 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:18.546079 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.545732 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:18.546079 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:18.545808 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:18.546079 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:18.545886 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls podName:4a2e454c-1d56-423a-a325-6f02ce1c9e85 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:34.545870542 +0000 UTC m=+170.401790469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-fjm8h" (UID: "4a2e454c-1d56-423a-a325-6f02ce1c9e85") : secret "cluster-monitoring-operator-tls" not found Jun 02 15:26:18.546342 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.546324 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/28929637-9b6e-436a-8eea-7d4cce493b5b-service-ca-bundle\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:18.548341 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.548320 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/28929637-9b6e-436a-8eea-7d4cce493b5b-metrics-certs\") pod \"router-default-7f6b7fc679-7x44m\" (UID: \"28929637-9b6e-436a-8eea-7d4cce493b5b\") " pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:18.606815 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.606790 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:18.733356 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:18.733321 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f6b7fc679-7x44m"] Jun 02 15:26:18.735933 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:18.735889 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28929637_9b6e_436a_8eea_7d4cce493b5b.slice/crio-be0b908679c9ffc55e719a6d592ece3695531996d16b3009990d5708d002a82d WatchSource:0}: Error finding container be0b908679c9ffc55e719a6d592ece3695531996d16b3009990d5708d002a82d: Status 404 returned error can't find the container with id be0b908679c9ffc55e719a6d592ece3695531996d16b3009990d5708d002a82d Jun 02 15:26:19.008518 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:19.008486 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" event={"ID":"28929637-9b6e-436a-8eea-7d4cce493b5b","Type":"ContainerStarted","Data":"e2065b0c69c9e22468c10726735b86cba1b2741cae6d58b84645dfb7ac7a2f89"} Jun 02 15:26:19.008691 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:19.008526 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" event={"ID":"28929637-9b6e-436a-8eea-7d4cce493b5b","Type":"ContainerStarted","Data":"be0b908679c9ffc55e719a6d592ece3695531996d16b3009990d5708d002a82d"} Jun 02 15:26:19.029150 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:19.029106 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" podStartSLOduration=17.029094008 podStartE2EDuration="17.029094008s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:19.028398402 +0000 UTC m=+154.884318348" watchObservedRunningTime="2026-06-02 15:26:19.029094008 +0000 UTC m=+154.885013953" Jun 02 15:26:19.607428 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:19.607375 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:19.609980 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:19.609958 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:20.010899 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:20.010867 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:20.012110 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:20.012087 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f6b7fc679-7x44m" Jun 02 15:26:24.100157 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:24.100110 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gzlx7" podUID="79d97372-9182-4b0d-9250-2d2cd6383c4f" Jun 02 15:26:24.105267 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:24.105249 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-484fv" podUID="49ac80c2-2ef3-4019-bf29-6516f3add356" Jun 02 15:26:25.022901 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:25.022818 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:26:25.023061 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:25.022818 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gzlx7" Jun 02 15:26:25.632429 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:25.632380 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-db66h" podUID="828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba" Jun 02 15:26:29.021379 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.021339 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:26:29.021379 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.021381 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:26:29.023897 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.023874 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79d97372-9182-4b0d-9250-2d2cd6383c4f-metrics-tls\") pod \"dns-default-gzlx7\" (UID: \"79d97372-9182-4b0d-9250-2d2cd6383c4f\") " pod="openshift-dns/dns-default-gzlx7" Jun 02 15:26:29.024035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.024003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49ac80c2-2ef3-4019-bf29-6516f3add356-cert\") pod \"ingress-canary-484fv\" (UID: \"49ac80c2-2ef3-4019-bf29-6516f3add356\") " pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:26:29.225917 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.225887 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqlt7\"" Jun 02 15:26:29.226203 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.226188 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wb47d\"" Jun 02 15:26:29.233937 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.233920 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-484fv" Jun 02 15:26:29.233988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.233947 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gzlx7" Jun 02 15:26:29.367472 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.367441 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-484fv"] Jun 02 15:26:29.372253 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:29.372225 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ac80c2_2ef3_4019_bf29_6516f3add356.slice/crio-52696a52084340192f7f777e525fba49b7f681bbe8390ef382ae474747c38660 WatchSource:0}: Error finding container 52696a52084340192f7f777e525fba49b7f681bbe8390ef382ae474747c38660: Status 404 returned error can't find the container with id 52696a52084340192f7f777e525fba49b7f681bbe8390ef382ae474747c38660 Jun 02 15:26:29.383341 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:29.383319 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gzlx7"] Jun 02 15:26:29.386276 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:29.386253 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d97372_9182_4b0d_9250_2d2cd6383c4f.slice/crio-8e0e81862eb15a7198e8b57f0ca437d6bf4768e12c646a65e24c76d4dd400399 WatchSource:0}: Error finding container 8e0e81862eb15a7198e8b57f0ca437d6bf4768e12c646a65e24c76d4dd400399: Status 404 returned error can't find the container with id 8e0e81862eb15a7198e8b57f0ca437d6bf4768e12c646a65e24c76d4dd400399 Jun 02 15:26:30.035761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:30.035728 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-484fv" event={"ID":"49ac80c2-2ef3-4019-bf29-6516f3add356","Type":"ContainerStarted","Data":"52696a52084340192f7f777e525fba49b7f681bbe8390ef382ae474747c38660"} Jun 02 15:26:30.037185 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:30.037149 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gzlx7" event={"ID":"79d97372-9182-4b0d-9250-2d2cd6383c4f","Type":"ContainerStarted","Data":"8e0e81862eb15a7198e8b57f0ca437d6bf4768e12c646a65e24c76d4dd400399"} Jun 02 15:26:31.041399 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:31.041360 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gzlx7" event={"ID":"79d97372-9182-4b0d-9250-2d2cd6383c4f","Type":"ContainerStarted","Data":"66eb9936b87dd85814412146594e92e26b73ead29c61d3cb990a0b553cc369b0"} Jun 02 15:26:32.047094 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:32.047056 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-484fv" event={"ID":"49ac80c2-2ef3-4019-bf29-6516f3add356","Type":"ContainerStarted","Data":"de6c3aaa464f0dcab22dbe193d6ecab5b19d66ed46d25a44f1034bde09aaabf1"} Jun 02 15:26:32.048531 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:32.048508 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gzlx7" event={"ID":"79d97372-9182-4b0d-9250-2d2cd6383c4f","Type":"ContainerStarted","Data":"0e3ff6d93781e7bedddcb3c930e9888d04299909330d3654c30d5caea9dddee5"} Jun 02 15:26:32.048648 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:32.048632 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gzlx7" Jun 02 15:26:32.065908 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:32.065867 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-484fv" podStartSLOduration=129.012576617 podStartE2EDuration="2m11.065855593s" podCreationTimestamp="2026-06-02 15:24:21 +0000 UTC" firstStartedPulling="2026-06-02 15:26:29.374054351 +0000 UTC m=+165.229974288" lastFinishedPulling="2026-06-02 15:26:31.427333338 +0000 UTC m=+167.283253264" observedRunningTime="2026-06-02 15:26:32.065083492 +0000 UTC m=+167.921003438" watchObservedRunningTime="2026-06-02 15:26:32.065855593 +0000 UTC m=+167.921775538" Jun 02 15:26:32.085796 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:32.085761 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gzlx7" podStartSLOduration=129.658121187 podStartE2EDuration="2m11.085751088s" podCreationTimestamp="2026-06-02 15:24:21 +0000 UTC" firstStartedPulling="2026-06-02 15:26:29.387936711 +0000 UTC m=+165.243856647" lastFinishedPulling="2026-06-02 15:26:30.815566621 +0000 UTC m=+166.671486548" observedRunningTime="2026-06-02 15:26:32.085290921 +0000 UTC m=+167.941210871" watchObservedRunningTime="2026-06-02 15:26:32.085751088 +0000 UTC m=+167.941671032" Jun 02 15:26:34.565068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:34.565013 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:34.567512 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:34.567488 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a2e454c-1d56-423a-a325-6f02ce1c9e85-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-fjm8h\" (UID: \"4a2e454c-1d56-423a-a325-6f02ce1c9e85\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:34.794261 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:34.794230 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" Jun 02 15:26:34.937101 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:34.937069 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h"] Jun 02 15:26:34.939771 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:34.939727 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2e454c_1d56_423a_a325_6f02ce1c9e85.slice/crio-0d62473e5de44b8d92dfc9ad0934194831d0f23342b7600809d58b2a7fed23e1 WatchSource:0}: Error finding container 0d62473e5de44b8d92dfc9ad0934194831d0f23342b7600809d58b2a7fed23e1: Status 404 returned error can't find the container with id 0d62473e5de44b8d92dfc9ad0934194831d0f23342b7600809d58b2a7fed23e1 Jun 02 15:26:35.055787 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:35.055752 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" event={"ID":"4a2e454c-1d56-423a-a325-6f02ce1c9e85","Type":"ContainerStarted","Data":"0d62473e5de44b8d92dfc9ad0934194831d0f23342b7600809d58b2a7fed23e1"} Jun 02 15:26:36.616548 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:36.616514 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:26:37.062025 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.061988 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" event={"ID":"4a2e454c-1d56-423a-a325-6f02ce1c9e85","Type":"ContainerStarted","Data":"39f82b06d9ff7645b351003362b7837c1459db187a590a2d518c8fef3b7d6214"} Jun 02 15:26:37.082100 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.082023 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-fjm8h" podStartSLOduration=33.023463549 podStartE2EDuration="35.082006531s" podCreationTimestamp="2026-06-02 15:26:02 +0000 UTC" firstStartedPulling="2026-06-02 15:26:34.941865453 +0000 UTC m=+170.797785389" lastFinishedPulling="2026-06-02 15:26:37.000408429 +0000 UTC m=+172.856328371" observedRunningTime="2026-06-02 15:26:37.08183764 +0000 UTC m=+172.937757587" watchObservedRunningTime="2026-06-02 15:26:37.082006531 +0000 UTC m=+172.937926476" Jun 02 15:26:37.713061 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.713030 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ffdfs"] Jun 02 15:26:37.716329 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.716304 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58d65f9c5-wbbxf"] Jun 02 15:26:37.716484 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.716467 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.719138 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.719120 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.723485 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.723382 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 15:26:37.723485 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.723480 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 15:26:37.723780 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.723757 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kbhxp\"" Jun 02 15:26:37.724238 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.724218 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 15:26:37.724347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.724293 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 15:26:37.724347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.724272 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 15:26:37.724505 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.724360 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 15:26:37.724505 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.724268 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 15:26:37.787923 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.787897 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d65f9c5-wbbxf"] Jun 02 15:26:37.788072 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53bca1db-58c0-4042-9c55-2c064a86b970-trusted-ca\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788111 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-registry-tls\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788162 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788118 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53bca1db-58c0-4042-9c55-2c064a86b970-installation-pull-secrets\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788204 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788193 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.788238 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.788294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-data-volume\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.788433 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788297 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53bca1db-58c0-4042-9c55-2c064a86b970-image-registry-private-configuration\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788433 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788331 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53bca1db-58c0-4042-9c55-2c064a86b970-ca-trust-extracted\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788433 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788350 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnn5t\" (UniqueName: \"kubernetes.io/projected/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-kube-api-access-rnn5t\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.788433 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53bca1db-58c0-4042-9c55-2c064a86b970-registry-certificates\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788615 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788453 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4689d\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-kube-api-access-4689d\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.788615 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788474 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-crio-socket\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.788615 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.788489 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-bound-sa-token\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.790115 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.790096 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nv42j\"" Jun 02 15:26:37.805997 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.805977 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffdfs"] Jun 02 15:26:37.829797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.829777 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 15:26:37.889157 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889098 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53bca1db-58c0-4042-9c55-2c064a86b970-installation-pull-secrets\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889157 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889136 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889184 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889213 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-data-volume\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889239 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53bca1db-58c0-4042-9c55-2c064a86b970-image-registry-private-configuration\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889276 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53bca1db-58c0-4042-9c55-2c064a86b970-ca-trust-extracted\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889304 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnn5t\" (UniqueName: \"kubernetes.io/projected/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-kube-api-access-rnn5t\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889333 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53bca1db-58c0-4042-9c55-2c064a86b970-registry-certificates\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889360 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4689d\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-kube-api-access-4689d\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889388 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-crio-socket\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889429 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-bound-sa-token\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889464 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53bca1db-58c0-4042-9c55-2c064a86b970-trusted-ca\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889492 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-registry-tls\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889869 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889625 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-data-volume\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889869 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889796 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53bca1db-58c0-4042-9c55-2c064a86b970-ca-trust-extracted\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.889974 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889884 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-crio-socket\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.889974 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.889912 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.891096 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.891073 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53bca1db-58c0-4042-9c55-2c064a86b970-registry-certificates\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.891222 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.891147 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53bca1db-58c0-4042-9c55-2c064a86b970-trusted-ca\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.892264 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.892241 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53bca1db-58c0-4042-9c55-2c064a86b970-image-registry-private-configuration\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.892356 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.892300 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.892480 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.892464 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-registry-tls\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.892701 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.892682 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53bca1db-58c0-4042-9c55-2c064a86b970-installation-pull-secrets\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.909102 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.909082 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4689d\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-kube-api-access-4689d\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:37.910082 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.910063 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnn5t\" (UniqueName: \"kubernetes.io/projected/91e55bb7-c15a-436a-ac84-7f34cb5e6bbf-kube-api-access-rnn5t\") pod \"insights-runtime-extractor-ffdfs\" (UID: \"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf\") " pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:37.912769 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:37.912744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53bca1db-58c0-4042-9c55-2c064a86b970-bound-sa-token\") pod \"image-registry-58d65f9c5-wbbxf\" (UID: \"53bca1db-58c0-4042-9c55-2c064a86b970\") " pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:38.026544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:38.026520 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffdfs" Jun 02 15:26:38.032249 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:38.032221 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:38.168998 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:38.168925 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffdfs"] Jun 02 15:26:38.172358 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:38.172319 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e55bb7_c15a_436a_ac84_7f34cb5e6bbf.slice/crio-efa2a38d760089f20a6b5d1adc859e54670af45e73dfa88c1647e664c0851a2d WatchSource:0}: Error finding container efa2a38d760089f20a6b5d1adc859e54670af45e73dfa88c1647e664c0851a2d: Status 404 returned error can't find the container with id efa2a38d760089f20a6b5d1adc859e54670af45e73dfa88c1647e664c0851a2d Jun 02 15:26:38.212840 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:38.212815 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d65f9c5-wbbxf"] Jun 02 15:26:38.215026 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:38.215002 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bca1db_58c0_4042_9c55_2c064a86b970.slice/crio-3e141cdf3a937c2bac2ca6872606a0bc23a555c5b7b3d071a7b6bdef796dd8f6 WatchSource:0}: Error finding container 3e141cdf3a937c2bac2ca6872606a0bc23a555c5b7b3d071a7b6bdef796dd8f6: Status 404 returned error can't find the container with id 3e141cdf3a937c2bac2ca6872606a0bc23a555c5b7b3d071a7b6bdef796dd8f6 Jun 02 15:26:39.067665 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:39.067625 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" event={"ID":"53bca1db-58c0-4042-9c55-2c064a86b970","Type":"ContainerStarted","Data":"568b9e98dcc4066a0b504d9daac857743a5f026f90d611c816374a30041d8650"} Jun 02 15:26:39.068091 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:39.067671 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" event={"ID":"53bca1db-58c0-4042-9c55-2c064a86b970","Type":"ContainerStarted","Data":"3e141cdf3a937c2bac2ca6872606a0bc23a555c5b7b3d071a7b6bdef796dd8f6"} Jun 02 15:26:39.068091 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:39.067786 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:26:39.069089 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:39.069054 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffdfs" event={"ID":"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf","Type":"ContainerStarted","Data":"d3315a0aee10118efd4d929f8bd0f7c72ee765ce127634e6c993a7f639fa41f7"} Jun 02 15:26:39.069089 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:39.069090 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffdfs" event={"ID":"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf","Type":"ContainerStarted","Data":"efa2a38d760089f20a6b5d1adc859e54670af45e73dfa88c1647e664c0851a2d"} Jun 02 15:26:39.097018 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:39.096964 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" podStartSLOduration=2.09694997 podStartE2EDuration="2.09694997s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:26:39.096740252 +0000 UTC m=+174.952660198" watchObservedRunningTime="2026-06-02 15:26:39.09694997 +0000 UTC m=+174.952869918" Jun 02 15:26:40.073107 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:40.073078 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffdfs" event={"ID":"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf","Type":"ContainerStarted","Data":"5b42bfd85777af37dc2c3509800ce24dd9a9a64ff048e53b3be68566aab27c5a"} Jun 02 15:26:42.053208 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:42.053180 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gzlx7" Jun 02 15:26:42.081222 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:42.081191 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffdfs" event={"ID":"91e55bb7-c15a-436a-ac84-7f34cb5e6bbf","Type":"ContainerStarted","Data":"ade4ea2c9a25c5edaf260f997cf4d6a142f7ba945a9951c8e8df4b37c0877f63"} Jun 02 15:26:43.679319 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.679267 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ffdfs" podStartSLOduration=3.672526558 podStartE2EDuration="6.679252887s" podCreationTimestamp="2026-06-02 15:26:37 +0000 UTC" firstStartedPulling="2026-06-02 15:26:38.24750389 +0000 UTC m=+174.103423816" lastFinishedPulling="2026-06-02 15:26:41.25423021 +0000 UTC m=+177.110150145" observedRunningTime="2026-06-02 15:26:42.129322161 +0000 UTC m=+177.985242107" watchObservedRunningTime="2026-06-02 15:26:43.679252887 +0000 UTC m=+179.535172832" Jun 02 15:26:43.680045 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.680026 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx"] Jun 02 15:26:43.683254 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.683239 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.685969 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.685951 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 15:26:43.686270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.686249 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 15:26:43.686836 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.686819 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 15:26:43.687023 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.687008 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xngtl\"" Jun 02 15:26:43.706853 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.706828 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx"] Jun 02 15:26:43.734031 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.733996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.734148 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.734063 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.734148 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.734109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.734148 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.734124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjmdq\" (UniqueName: \"kubernetes.io/projected/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-kube-api-access-tjmdq\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.834741 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.834716 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.834836 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.834771 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.834836 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.834801 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tjmdq\" (UniqueName: \"kubernetes.io/projected/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-kube-api-access-tjmdq\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.834911 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.834836 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.835433 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.835390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.837204 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.837175 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.837352 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.837333 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.844148 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.844128 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjmdq\" (UniqueName: \"kubernetes.io/projected/f3b7412b-d8a6-4397-ad3c-948f73d2fcb0-kube-api-access-tjmdq\") pod \"prometheus-operator-658bcd8bdf-v2pjx\" (UID: \"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:43.992290 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:43.992267 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" Jun 02 15:26:44.122650 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:44.122621 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx"] Jun 02 15:26:44.125604 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:44.125578 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b7412b_d8a6_4397_ad3c_948f73d2fcb0.slice/crio-f47de31643c3255bd7f225261905b189fe4472a17b9986b88c75ceb1f359f317 WatchSource:0}: Error finding container f47de31643c3255bd7f225261905b189fe4472a17b9986b88c75ceb1f359f317: Status 404 returned error can't find the container with id f47de31643c3255bd7f225261905b189fe4472a17b9986b88c75ceb1f359f317 Jun 02 15:26:45.090231 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.090199 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" event={"ID":"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0","Type":"ContainerStarted","Data":"f47de31643c3255bd7f225261905b189fe4472a17b9986b88c75ceb1f359f317"} Jun 02 15:26:45.919767 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.919736 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d8b95bc6-p56th"] Jun 02 15:26:45.922781 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.922764 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:45.927850 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.927819 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 15:26:45.928761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.928737 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 15:26:45.928890 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.928737 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 15:26:45.928890 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.928737 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g87xd\"" Jun 02 15:26:45.928890 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.928737 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 15:26:45.929699 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.929681 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 15:26:45.929805 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.929686 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 15:26:45.929878 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.929813 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 15:26:45.935685 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.935663 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d8b95bc6-p56th"] Jun 02 15:26:45.937449 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:45.937430 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 15:26:46.050223 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050201 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cx2g\" (UniqueName: \"kubernetes.io/projected/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-kube-api-access-7cx2g\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.050361 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-oauth-serving-cert\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.050361 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-trusted-ca-bundle\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.050361 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-service-ca\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.050361 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050347 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-config\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.050534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050366 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-oauth-config\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.050534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.050391 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-serving-cert\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.093764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.093742 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" event={"ID":"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0","Type":"ContainerStarted","Data":"e5e138cb211e36b1a8953ed3f4647e3cd8daf8cdc346e2b26ca14b149b64c8d9"} Jun 02 15:26:46.093764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.093769 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" event={"ID":"f3b7412b-d8a6-4397-ad3c-948f73d2fcb0","Type":"ContainerStarted","Data":"90b48d666c60580af856d1cb19c875199479b1a47c66abcf0f426fe5da2cae76"} Jun 02 15:26:46.114243 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.114201 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-v2pjx" podStartSLOduration=1.82406128 podStartE2EDuration="3.114187914s" podCreationTimestamp="2026-06-02 15:26:43 +0000 UTC" firstStartedPulling="2026-06-02 15:26:44.127331444 +0000 UTC m=+179.983251380" lastFinishedPulling="2026-06-02 15:26:45.417458077 +0000 UTC m=+181.273378014" observedRunningTime="2026-06-02 15:26:46.113291961 +0000 UTC m=+181.969211905" watchObservedRunningTime="2026-06-02 15:26:46.114187914 +0000 UTC m=+181.970107860" Jun 02 15:26:46.151163 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151137 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cx2g\" (UniqueName: \"kubernetes.io/projected/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-kube-api-access-7cx2g\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.151270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151197 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-oauth-serving-cert\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.151270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151252 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-trusted-ca-bundle\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.151377 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151286 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-service-ca\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.151377 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151316 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-config\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.151377 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151345 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-oauth-config\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.151549 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151381 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-serving-cert\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.152035 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.151999 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-oauth-serving-cert\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.152107 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.152049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-service-ca\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.152107 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.152061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-config\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.152377 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.152290 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-trusted-ca-bundle\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.154619 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.154596 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-oauth-config\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.154798 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.154779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-serving-cert\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.161181 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.161158 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cx2g\" (UniqueName: \"kubernetes.io/projected/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-kube-api-access-7cx2g\") pod \"console-64d8b95bc6-p56th\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.232509 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.232489 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:46.358009 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:46.357986 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d8b95bc6-p56th"] Jun 02 15:26:46.360367 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:46.360340 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4e0420_6408_4c0d_8edd_0fe0c86e3c3d.slice/crio-3fda3648f498fc33f8ea4fca5b05b17c48541b94bf56de276b6b580e9215f841 WatchSource:0}: Error finding container 3fda3648f498fc33f8ea4fca5b05b17c48541b94bf56de276b6b580e9215f841: Status 404 returned error can't find the container with id 3fda3648f498fc33f8ea4fca5b05b17c48541b94bf56de276b6b580e9215f841 Jun 02 15:26:47.097074 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:47.097038 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8b95bc6-p56th" event={"ID":"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d","Type":"ContainerStarted","Data":"3fda3648f498fc33f8ea4fca5b05b17c48541b94bf56de276b6b580e9215f841"} Jun 02 15:26:48.262194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.261575 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mr2lk"] Jun 02 15:26:48.265597 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.265572 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.268907 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.268555 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 15:26:48.268907 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.268632 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xvk85\"" Jun 02 15:26:48.268907 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.268555 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 15:26:48.269327 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.269308 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 15:26:48.370596 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370559 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70049eb-2158-4d0b-8ea2-b45dca08fda0-metrics-client-ca\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-tls\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370647 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hsrr\" (UniqueName: \"kubernetes.io/projected/b70049eb-2158-4d0b-8ea2-b45dca08fda0-kube-api-access-4hsrr\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370679 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-root\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370703 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-sys\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370745 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.370765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370768 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-textfile\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.371125 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.370807 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-wtmp\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472186 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-wtmp\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472227 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70049eb-2158-4d0b-8ea2-b45dca08fda0-metrics-client-ca\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472265 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-tls\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472300 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472310 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-wtmp\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472326 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hsrr\" (UniqueName: \"kubernetes.io/projected/b70049eb-2158-4d0b-8ea2-b45dca08fda0-kube-api-access-4hsrr\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472672 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472368 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-root\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472672 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472396 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-sys\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472672 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472454 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472672 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472487 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-textfile\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472672 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:48.472505 2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 15:26:48.472672 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:48.472574 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-tls podName:b70049eb-2158-4d0b-8ea2-b45dca08fda0 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:48.972552014 +0000 UTC m=+184.828471959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-tls") pod "node-exporter-mr2lk" (UID: "b70049eb-2158-4d0b-8ea2-b45dca08fda0") : secret "node-exporter-tls" not found Jun 02 15:26:48.472988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472771 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-textfile\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472841 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-sys\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472877 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b70049eb-2158-4d0b-8ea2-b45dca08fda0-root\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.472988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.472883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b70049eb-2158-4d0b-8ea2-b45dca08fda0-metrics-client-ca\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.473249 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.473229 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-accelerators-collector-config\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.475694 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.475670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.481760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.481740 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hsrr\" (UniqueName: \"kubernetes.io/projected/b70049eb-2158-4d0b-8ea2-b45dca08fda0-kube-api-access-4hsrr\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.975861 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.975828 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-tls\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:48.978700 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:48.978671 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b70049eb-2158-4d0b-8ea2-b45dca08fda0-node-exporter-tls\") pod \"node-exporter-mr2lk\" (UID: \"b70049eb-2158-4d0b-8ea2-b45dca08fda0\") " pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:49.178196 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:49.178164 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mr2lk" Jun 02 15:26:49.537284 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:49.537250 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70049eb_2158_4d0b_8ea2_b45dca08fda0.slice/crio-d516465c6963300fd5335f93a2a8c9e8461d09617fb0b0ea4dfd85435fdd6890 WatchSource:0}: Error finding container d516465c6963300fd5335f93a2a8c9e8461d09617fb0b0ea4dfd85435fdd6890: Status 404 returned error can't find the container with id d516465c6963300fd5335f93a2a8c9e8461d09617fb0b0ea4dfd85435fdd6890 Jun 02 15:26:50.111935 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:50.111881 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8b95bc6-p56th" event={"ID":"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d","Type":"ContainerStarted","Data":"8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc"} Jun 02 15:26:50.113368 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:50.113316 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2lk" event={"ID":"b70049eb-2158-4d0b-8ea2-b45dca08fda0","Type":"ContainerStarted","Data":"d516465c6963300fd5335f93a2a8c9e8461d09617fb0b0ea4dfd85435fdd6890"} Jun 02 15:26:50.153939 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:50.153888 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-64d8b95bc6-p56th" podStartSLOduration=1.922765724 podStartE2EDuration="5.153872502s" podCreationTimestamp="2026-06-02 15:26:45 +0000 UTC" firstStartedPulling="2026-06-02 15:26:46.362131856 +0000 UTC m=+182.218051782" lastFinishedPulling="2026-06-02 15:26:49.593238635 +0000 UTC m=+185.449158560" observedRunningTime="2026-06-02 15:26:50.153223692 +0000 UTC m=+186.009143640" watchObservedRunningTime="2026-06-02 15:26:50.153872502 +0000 UTC m=+186.009792448" Jun 02 15:26:51.117971 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.117936 2567 generic.go:358] "Generic (PLEG): container finished" podID="b70049eb-2158-4d0b-8ea2-b45dca08fda0" containerID="52188268083aaab0a6d1dac989ddca0e42ffc7af674129682ed9e782931b9ecd" exitCode=0 Jun 02 15:26:51.118316 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.118017 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2lk" event={"ID":"b70049eb-2158-4d0b-8ea2-b45dca08fda0","Type":"ContainerDied","Data":"52188268083aaab0a6d1dac989ddca0e42ffc7af674129682ed9e782931b9ecd"} Jun 02 15:26:51.264007 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.263976 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f4ddb4587-f6bgg"] Jun 02 15:26:51.268111 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.268080 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.272311 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.272281 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 02 15:26:51.272744 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.272590 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 02 15:26:51.273608 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.273586 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4cskqi7u4389\"" Jun 02 15:26:51.273839 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.273818 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 02 15:26:51.274047 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.274027 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hchdf\"" Jun 02 15:26:51.274146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.274029 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 02 15:26:51.274146 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.274066 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 02 15:26:51.289734 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.289702 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4ddb4587-f6bgg"] Jun 02 15:26:51.397775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397714 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.397775 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.397976 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397790 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c28d833-f0ad-471e-b930-892a4ea3cfd6-metrics-client-ca\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.397976 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.397976 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397911 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2gg\" (UniqueName: \"kubernetes.io/projected/3c28d833-f0ad-471e-b930-892a4ea3cfd6-kube-api-access-tt2gg\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.397976 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397950 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-tls\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.398107 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.397989 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-grpc-tls\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.398107 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.398051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.498956 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.498928 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2gg\" (UniqueName: \"kubernetes.io/projected/3c28d833-f0ad-471e-b930-892a4ea3cfd6-kube-api-access-tt2gg\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.498968 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-tls\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.498985 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-grpc-tls\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.499012 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.499058 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.499088 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499357 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.499180 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c28d833-f0ad-471e-b930-892a4ea3cfd6-metrics-client-ca\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.499357 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.499227 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.500303 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.500196 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c28d833-f0ad-471e-b930-892a4ea3cfd6-metrics-client-ca\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.502130 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.502100 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.502222 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.502144 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-tls\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.502619 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.502598 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.502700 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.502616 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.502700 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.502632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-grpc-tls\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.502700 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.502636 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c28d833-f0ad-471e-b930-892a4ea3cfd6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.509073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.509057 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2gg\" (UniqueName: \"kubernetes.io/projected/3c28d833-f0ad-471e-b930-892a4ea3cfd6-kube-api-access-tt2gg\") pod \"thanos-querier-f4ddb4587-f6bgg\" (UID: \"3c28d833-f0ad-471e-b930-892a4ea3cfd6\") " pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.579251 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.579227 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:51.719941 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:51.719906 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f4ddb4587-f6bgg"] Jun 02 15:26:51.723779 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:51.723753 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c28d833_f0ad_471e_b930_892a4ea3cfd6.slice/crio-af594ab90fbc3fcbd31fa88ec93e9e369a43cf5a1d26ffe29dc3adeab2afaa07 WatchSource:0}: Error finding container af594ab90fbc3fcbd31fa88ec93e9e369a43cf5a1d26ffe29dc3adeab2afaa07: Status 404 returned error can't find the container with id af594ab90fbc3fcbd31fa88ec93e9e369a43cf5a1d26ffe29dc3adeab2afaa07 Jun 02 15:26:52.124117 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.124083 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2lk" event={"ID":"b70049eb-2158-4d0b-8ea2-b45dca08fda0","Type":"ContainerStarted","Data":"8d3655e912ef4f62ac83b94ba1c6130e2c040a2a033b73d668176c835cff0225"} Jun 02 15:26:52.124592 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.124124 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mr2lk" event={"ID":"b70049eb-2158-4d0b-8ea2-b45dca08fda0","Type":"ContainerStarted","Data":"b174de680910dd1bf81f738dece9ba1d0971eae452056ef45655c1248c4cf57b"} Jun 02 15:26:52.125059 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.125038 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"af594ab90fbc3fcbd31fa88ec93e9e369a43cf5a1d26ffe29dc3adeab2afaa07"} Jun 02 15:26:52.160244 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.160202 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mr2lk" podStartSLOduration=3.313108954 podStartE2EDuration="4.160187275s" podCreationTimestamp="2026-06-02 15:26:48 +0000 UTC" firstStartedPulling="2026-06-02 15:26:49.539205461 +0000 UTC m=+185.395125384" lastFinishedPulling="2026-06-02 15:26:50.386283782 +0000 UTC m=+186.242203705" observedRunningTime="2026-06-02 15:26:52.159816956 +0000 UTC m=+188.015736900" watchObservedRunningTime="2026-06-02 15:26:52.160187275 +0000 UTC m=+188.016107220" Jun 02 15:26:52.706670 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.706634 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f54f9b78b-hw7sr"] Jun 02 15:26:52.713241 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.713211 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.716139 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.716092 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 02 15:26:52.716280 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.716262 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bt4n9\"" Jun 02 15:26:52.716629 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.716610 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 02 15:26:52.717048 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.717023 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-a4sj9orclv2fg\"" Jun 02 15:26:52.717149 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.717053 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 02 15:26:52.717149 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.717022 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 15:26:52.721967 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.721945 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f54f9b78b-hw7sr"] Jun 02 15:26:52.810052 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810021 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-secret-metrics-server-tls\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.810194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/534f8ba2-a870-477b-b479-02cec1c972b4-audit-log\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.810194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810110 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-client-ca-bundle\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.810194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/534f8ba2-a870-477b-b479-02cec1c972b4-metrics-server-audit-profiles\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.810194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810188 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79s56\" (UniqueName: \"kubernetes.io/projected/534f8ba2-a870-477b-b479-02cec1c972b4-kube-api-access-79s56\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.810321 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810206 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534f8ba2-a870-477b-b479-02cec1c972b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.810321 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.810228 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-secret-metrics-server-client-certs\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.911574 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911542 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/534f8ba2-a870-477b-b479-02cec1c972b4-audit-log\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.911764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-client-ca-bundle\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.911764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911674 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/534f8ba2-a870-477b-b479-02cec1c972b4-metrics-server-audit-profiles\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.911764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911701 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79s56\" (UniqueName: \"kubernetes.io/projected/534f8ba2-a870-477b-b479-02cec1c972b4-kube-api-access-79s56\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.911764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911729 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534f8ba2-a870-477b-b479-02cec1c972b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.911764 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911758 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-secret-metrics-server-client-certs\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.912029 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911778 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-secret-metrics-server-tls\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.912029 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.911998 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/534f8ba2-a870-477b-b479-02cec1c972b4-audit-log\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.912566 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.912514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/534f8ba2-a870-477b-b479-02cec1c972b4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.912698 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.912678 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/534f8ba2-a870-477b-b479-02cec1c972b4-metrics-server-audit-profiles\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.914284 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.914266 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-client-ca-bundle\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.914910 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.914887 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-secret-metrics-server-client-certs\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.914986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.914967 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/534f8ba2-a870-477b-b479-02cec1c972b4-secret-metrics-server-tls\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.931954 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.931923 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79s56\" (UniqueName: \"kubernetes.io/projected/534f8ba2-a870-477b-b479-02cec1c972b4-kube-api-access-79s56\") pod \"metrics-server-5f54f9b78b-hw7sr\" (UID: \"534f8ba2-a870-477b-b479-02cec1c972b4\") " pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:52.941571 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.941545 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv"] Jun 02 15:26:52.945885 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.945869 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:52.949984 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.949965 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-r9gs4\"" Jun 02 15:26:52.950294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.950276 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 15:26:52.956640 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:52.956621 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv"] Jun 02 15:26:53.012647 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:53.012620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dkqgv\" (UID: \"b49cb86a-0db8-487e-934f-6dd918c92255\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:53.025627 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:53.025597 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:26:53.114266 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:53.113727 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dkqgv\" (UID: \"b49cb86a-0db8-487e-934f-6dd918c92255\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:53.114266 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:53.113941 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 15:26:53.114266 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:53.114014 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert podName:b49cb86a-0db8-487e-934f-6dd918c92255 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:53.61399573 +0000 UTC m=+189.469915656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-dkqgv" (UID: "b49cb86a-0db8-487e-934f-6dd918c92255") : secret "monitoring-plugin-cert" not found Jun 02 15:26:53.184022 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:53.183977 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f54f9b78b-hw7sr"] Jun 02 15:26:53.188283 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:53.188139 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534f8ba2_a870_477b_b479_02cec1c972b4.slice/crio-d2180906432f708b9a7609dadb36217945a836b3222690bf652786abbd03a955 WatchSource:0}: Error finding container d2180906432f708b9a7609dadb36217945a836b3222690bf652786abbd03a955: Status 404 returned error can't find the container with id d2180906432f708b9a7609dadb36217945a836b3222690bf652786abbd03a955 Jun 02 15:26:53.617659 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:53.617625 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dkqgv\" (UID: \"b49cb86a-0db8-487e-934f-6dd918c92255\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:53.617846 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:53.617783 2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 15:26:53.617905 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:26:53.617860 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert podName:b49cb86a-0db8-487e-934f-6dd918c92255 nodeName:}" failed. No retries permitted until 2026-06-02 15:26:54.617830735 +0000 UTC m=+190.473750678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-dkqgv" (UID: "b49cb86a-0db8-487e-934f-6dd918c92255") : secret "monitoring-plugin-cert" not found Jun 02 15:26:53.757284 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:53.757248 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d8b95bc6-p56th"] Jun 02 15:26:54.133433 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.133375 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" event={"ID":"534f8ba2-a870-477b-b479-02cec1c972b4","Type":"ContainerStarted","Data":"d2180906432f708b9a7609dadb36217945a836b3222690bf652786abbd03a955"} Jun 02 15:26:54.629141 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.629105 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dkqgv\" (UID: \"b49cb86a-0db8-487e-934f-6dd918c92255\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:54.632070 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.632049 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b49cb86a-0db8-487e-934f-6dd918c92255-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-dkqgv\" (UID: \"b49cb86a-0db8-487e-934f-6dd918c92255\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:54.695076 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.695036 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:26:54.699732 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.699706 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.705457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705208 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 15:26:54.705457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705284 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bfkusv7v2s8g0\"" Jun 02 15:26:54.705457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705290 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 15:26:54.705457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705321 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5mj9\"" Jun 02 15:26:54.705457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705208 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 15:26:54.705457 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705445 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 15:26:54.705831 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.705682 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 15:26:54.706064 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.706043 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 15:26:54.706310 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.706290 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 15:26:54.706407 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.706334 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 15:26:54.706407 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.706343 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 15:26:54.706651 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.706632 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 15:26:54.714167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.713731 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 15:26:54.715289 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.715268 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 15:26:54.725750 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.725724 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:26:54.755857 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.755785 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:54.830670 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545c7\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-kube-api-access-545c7\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.830863 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830694 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.830863 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830715 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.830863 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830744 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.830863 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-config\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.830863 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830875 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830893 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830908 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830949 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.830978 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831006 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831028 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831047 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831078 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831082 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831342 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831096 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831342 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831141 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.831342 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.831183 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.934668 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934615 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.934779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934687 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.934779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.934779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934740 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.934779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934769 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934804 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-545c7\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-kube-api-access-545c7\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934853 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934879 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934926 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934959 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-config\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.934990 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935022 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935056 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935082 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935116 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935140 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935181 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.935286 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.935207 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.938034 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.936176 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.938034 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.936297 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.938034 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.937523 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.938034 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.937687 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.940348 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.940043 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-config\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.940348 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.940301 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.944904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.941987 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.947443 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.947376 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.948177 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.948029 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.948177 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.948131 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-config-out\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.948536 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.948453 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.950914 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.950047 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.950914 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.950493 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-web-config\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.950914 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.950605 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.950914 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.950612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.953237 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.953189 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.953237 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.953206 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:54.955954 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:54.955932 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-545c7\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-kube-api-access-545c7\") pod \"prometheus-k8s-0\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:55.022617 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.021154 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:26:55.075154 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.075116 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv"] Jun 02 15:26:55.082917 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:55.082885 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49cb86a_0db8_487e_934f_6dd918c92255.slice/crio-9e150fa4c5f0ab093922b76dd030a76c5efd22c7d9b862037ba9bd3c6d3eae8d WatchSource:0}: Error finding container 9e150fa4c5f0ab093922b76dd030a76c5efd22c7d9b862037ba9bd3c6d3eae8d: Status 404 returned error can't find the container with id 9e150fa4c5f0ab093922b76dd030a76c5efd22c7d9b862037ba9bd3c6d3eae8d Jun 02 15:26:55.140250 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.140187 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" event={"ID":"534f8ba2-a870-477b-b479-02cec1c972b4","Type":"ContainerStarted","Data":"dc3e322e36e23b3e165138a41c868ed1b312a7ce142f06513b58031237ce91aa"} Jun 02 15:26:55.142964 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.142857 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"466cdf5b0835316365b0c35ff77c8999e7c5ef8793a01a4b780eb496bd4f3554"} Jun 02 15:26:55.142964 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.142908 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"a1348d2a1b43dcc8919312a4439229517e157a1cb338931907d4a8137317c78a"} Jun 02 15:26:55.142964 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.142929 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"bf35fe8150b991ce6bb70d8748a2f328623e43e7632feba52be0ece7af31b271"} Jun 02 15:26:55.144092 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.144034 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" event={"ID":"b49cb86a-0db8-487e-934f-6dd918c92255","Type":"ContainerStarted","Data":"9e150fa4c5f0ab093922b76dd030a76c5efd22c7d9b862037ba9bd3c6d3eae8d"} Jun 02 15:26:55.172744 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.172634 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" podStartSLOduration=1.484011994 podStartE2EDuration="3.172614624s" podCreationTimestamp="2026-06-02 15:26:52 +0000 UTC" firstStartedPulling="2026-06-02 15:26:53.189608739 +0000 UTC m=+189.045528663" lastFinishedPulling="2026-06-02 15:26:54.878211357 +0000 UTC m=+190.734131293" observedRunningTime="2026-06-02 15:26:55.171372048 +0000 UTC m=+191.027291997" watchObservedRunningTime="2026-06-02 15:26:55.172614624 +0000 UTC m=+191.028534569" Jun 02 15:26:55.208913 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:55.208781 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:26:55.211283 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:26:55.211246 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82561b6c_fb64_4af6_a623_1e019602cc6f.slice/crio-56a70f0329c1effd06cf0607c1882102d467075fbe0ad1c934725224c5893559 WatchSource:0}: Error finding container 56a70f0329c1effd06cf0607c1882102d467075fbe0ad1c934725224c5893559: Status 404 returned error can't find the container with id 56a70f0329c1effd06cf0607c1882102d467075fbe0ad1c934725224c5893559 Jun 02 15:26:56.149526 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:56.149487 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"56a70f0329c1effd06cf0607c1882102d467075fbe0ad1c934725224c5893559"} Jun 02 15:26:56.233431 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:56.233380 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:26:57.153408 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.153368 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="8377c696460575f5c101365c4e89c1beb342d62ab12536bcb70a4943b7963fc0" exitCode=0 Jun 02 15:26:57.153861 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.153460 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"8377c696460575f5c101365c4e89c1beb342d62ab12536bcb70a4943b7963fc0"} Jun 02 15:26:57.156270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.156242 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"162eeaf7baef4aa03de2a90819d63bb38d27e852bb019fc574e780e7c240dd85"} Jun 02 15:26:57.156270 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.156270 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"2b660ed166070255fd11c0e4811ea350b2cb51236562631cf7fdd891b1be5cfb"} Jun 02 15:26:57.156437 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.156286 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" event={"ID":"3c28d833-f0ad-471e-b930-892a4ea3cfd6","Type":"ContainerStarted","Data":"4e8989fb90f5645468570a13d2b0af67857574735bf85ca4e40093fc1c496040"} Jun 02 15:26:57.156498 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.156462 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:26:57.157698 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.157660 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" event={"ID":"b49cb86a-0db8-487e-934f-6dd918c92255","Type":"ContainerStarted","Data":"684852f8bf90dc67fa672246380acd409694cf071036e1ffd89101d7649f2889"} Jun 02 15:26:57.157886 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.157869 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:57.162962 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.162942 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" Jun 02 15:26:57.251269 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.251185 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" podStartSLOduration=1.242940761 podStartE2EDuration="6.251172508s" podCreationTimestamp="2026-06-02 15:26:51 +0000 UTC" firstStartedPulling="2026-06-02 15:26:51.72585858 +0000 UTC m=+187.581778503" lastFinishedPulling="2026-06-02 15:26:56.734090318 +0000 UTC m=+192.590010250" observedRunningTime="2026-06-02 15:26:57.250392982 +0000 UTC m=+193.106312928" watchObservedRunningTime="2026-06-02 15:26:57.251172508 +0000 UTC m=+193.107092450" Jun 02 15:26:57.266645 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:26:57.266606 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-dkqgv" podStartSLOduration=3.610744476 podStartE2EDuration="5.266590043s" podCreationTimestamp="2026-06-02 15:26:52 +0000 UTC" firstStartedPulling="2026-06-02 15:26:55.085277929 +0000 UTC m=+190.941197855" lastFinishedPulling="2026-06-02 15:26:56.7411235 +0000 UTC m=+192.597043422" observedRunningTime="2026-06-02 15:26:57.266130789 +0000 UTC m=+193.122050735" watchObservedRunningTime="2026-06-02 15:26:57.266590043 +0000 UTC m=+193.122509988" Jun 02 15:27:00.079272 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:00.079231 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58d65f9c5-wbbxf" Jun 02 15:27:01.176316 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.176279 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"49ae9f0010fd0d805f4b985ab7a3f81152ecef50b02869d9c1af74722d94eea7"} Jun 02 15:27:01.176316 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.176314 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"2b00f88bf2896b97191ddb30d32b79027918bd360deecd2fb6588d7750345037"} Jun 02 15:27:01.176316 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.176323 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"1a701321fe0afba42f6b59b6a63fb632826fabdba6fd9bde7412836b1aede5b8"} Jun 02 15:27:01.176900 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.176331 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"ea50d25ce69339270f51cba81f8f51624c359241e437061f89f2cc53af7f8ae9"} Jun 02 15:27:01.176900 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.176340 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"41378eed208325da1ed7b748856c9c52ca086a7cabd83902b86824d1949e9f73"} Jun 02 15:27:01.176900 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.176350 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerStarted","Data":"02673eff3c73da9f8b92eb9a01c04ddc778a32193f0649cca56dfdf234f6bb89"} Jun 02 15:27:01.228988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:01.228930 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.967818029 podStartE2EDuration="7.228915906s" podCreationTimestamp="2026-06-02 15:26:54 +0000 UTC" firstStartedPulling="2026-06-02 15:26:55.213175303 +0000 UTC m=+191.069095227" lastFinishedPulling="2026-06-02 15:27:00.474273162 +0000 UTC m=+196.330193104" observedRunningTime="2026-06-02 15:27:01.221057346 +0000 UTC m=+197.076977290" watchObservedRunningTime="2026-06-02 15:27:01.228915906 +0000 UTC m=+197.084835851" Jun 02 15:27:03.169529 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:03.169500 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f4ddb4587-f6bgg" Jun 02 15:27:05.022279 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:05.022246 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:27:12.209968 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:12.209879 2567 generic.go:358] "Generic (PLEG): container finished" podID="a886587d-a56b-47e1-9a01-db002a40d171" containerID="0868e7bdc27f8d3143f09046f0e53c959284cede31e34a3eaaf4967708491f5b" exitCode=0 Jun 02 15:27:12.209968 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:12.209951 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" event={"ID":"a886587d-a56b-47e1-9a01-db002a40d171","Type":"ContainerDied","Data":"0868e7bdc27f8d3143f09046f0e53c959284cede31e34a3eaaf4967708491f5b"} Jun 02 15:27:12.210350 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:12.210253 2567 scope.go:117] "RemoveContainer" containerID="0868e7bdc27f8d3143f09046f0e53c959284cede31e34a3eaaf4967708491f5b" Jun 02 15:27:13.025924 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:13.025882 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:27:13.026105 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:13.025955 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:27:13.215197 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:13.215166 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6bn2f" event={"ID":"a886587d-a56b-47e1-9a01-db002a40d171","Type":"ContainerStarted","Data":"bc2aa8e8cc1f33c96c9f7799dbb3ae7593b5027c9f66e58e7de6200071ff5e9c"} Jun 02 15:27:16.224314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:16.224273 2567 generic.go:358] "Generic (PLEG): container finished" podID="7d23b6c7-b5c5-479b-a27a-14fc6685b3ee" containerID="f3618c8fc6d77c47b2d0b1189457e97193a3d030fefea8befc628b65ab6d36c0" exitCode=0 Jun 02 15:27:16.224736 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:16.224320 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" event={"ID":"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee","Type":"ContainerDied","Data":"f3618c8fc6d77c47b2d0b1189457e97193a3d030fefea8befc628b65ab6d36c0"} Jun 02 15:27:16.224802 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:16.224736 2567 scope.go:117] "RemoveContainer" containerID="f3618c8fc6d77c47b2d0b1189457e97193a3d030fefea8befc628b65ab6d36c0" Jun 02 15:27:17.228665 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:17.228632 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-clgzt" event={"ID":"7d23b6c7-b5c5-479b-a27a-14fc6685b3ee","Type":"ContainerStarted","Data":"2226640a1191692d1d6973b0f5c87a774d22ff0979d2e70942471ac61eb364d2"} Jun 02 15:27:18.776566 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:18.776511 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-64d8b95bc6-p56th" podUID="4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" containerName="console" containerID="cri-o://8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc" gracePeriod=15 Jun 02 15:27:19.019180 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.019153 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64d8b95bc6-p56th_4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d/console/0.log" Jun 02 15:27:19.019275 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.019223 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:27:19.039968 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.039902 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-config\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.039968 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.039944 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cx2g\" (UniqueName: \"kubernetes.io/projected/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-kube-api-access-7cx2g\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.040143 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.039993 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-service-ca\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.040143 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040018 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-trusted-ca-bundle\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.040143 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040041 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-oauth-config\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.040143 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040096 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-oauth-serving-cert\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.040143 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040123 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-serving-cert\") pod \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\" (UID: \"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d\") " Jun 02 15:27:19.040370 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040322 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-config" (OuterVolumeSpecName: "console-config") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:19.040444 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040399 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:19.040492 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040445 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:19.040636 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.040617 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:27:19.042796 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.042766 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-kube-api-access-7cx2g" (OuterVolumeSpecName: "kube-api-access-7cx2g") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "kube-api-access-7cx2g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:27:19.042796 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.042777 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:19.042929 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.042852 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" (UID: "4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:27:19.141151 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141121 2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-service-ca\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.141151 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141149 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-trusted-ca-bundle\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.141323 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141162 2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-oauth-config\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.141323 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141175 2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-oauth-serving-cert\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.141323 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141204 2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-serving-cert\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.141323 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141221 2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-console-config\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.141323 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.141233 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cx2g\" (UniqueName: \"kubernetes.io/projected/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d-kube-api-access-7cx2g\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:27:19.235734 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.235709 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64d8b95bc6-p56th_4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d/console/0.log" Jun 02 15:27:19.235847 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.235745 2567 generic.go:358] "Generic (PLEG): container finished" podID="4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" containerID="8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc" exitCode=2 Jun 02 15:27:19.235847 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.235772 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8b95bc6-p56th" event={"ID":"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d","Type":"ContainerDied","Data":"8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc"} Jun 02 15:27:19.235847 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.235803 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d8b95bc6-p56th" event={"ID":"4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d","Type":"ContainerDied","Data":"3fda3648f498fc33f8ea4fca5b05b17c48541b94bf56de276b6b580e9215f841"} Jun 02 15:27:19.235847 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.235814 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d8b95bc6-p56th" Jun 02 15:27:19.235986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.235817 2567 scope.go:117] "RemoveContainer" containerID="8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc" Jun 02 15:27:19.245431 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.245394 2567 scope.go:117] "RemoveContainer" containerID="8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc" Jun 02 15:27:19.245684 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:27:19.245656 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc\": container with ID starting with 8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc not found: ID does not exist" containerID="8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc" Jun 02 15:27:19.245752 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.245696 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc"} err="failed to get container status \"8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc\": rpc error: code = NotFound desc = could not find container \"8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc\": container with ID starting with 8de586f11ec46c782f1dc82e43da20b94d276b236f31694ad2806dbe5fdc4edc not found: ID does not exist" Jun 02 15:27:19.258354 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.258332 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d8b95bc6-p56th"] Jun 02 15:27:19.261124 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:19.261103 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d8b95bc6-p56th"] Jun 02 15:27:20.624020 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:20.623987 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" path="/var/lib/kubelet/pods/4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d/volumes" Jun 02 15:27:33.031003 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:33.030963 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:27:33.034730 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:33.034709 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f54f9b78b-hw7sr" Jun 02 15:27:55.022761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:55.022674 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:27:55.039733 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:55.039708 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:27:55.359181 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:55.359105 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:27:56.547859 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:56.547829 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:27:56.550235 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:56.550214 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba-metrics-certs\") pod \"network-metrics-daemon-db66h\" (UID: \"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba\") " pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:27:56.720746 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:56.720717 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8csp4\"" Jun 02 15:27:56.728088 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:56.728069 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-db66h" Jun 02 15:27:56.901891 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:56.901858 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-db66h"] Jun 02 15:27:56.905334 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:27:56.905303 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828a0ee4_43b7_46bf_a0ea_f392c9e6c5ba.slice/crio-a06738d07c3f9827015e71cbb09af43c2a64c3dccdfaf9084c721b6128382f76 WatchSource:0}: Error finding container a06738d07c3f9827015e71cbb09af43c2a64c3dccdfaf9084c721b6128382f76: Status 404 returned error can't find the container with id a06738d07c3f9827015e71cbb09af43c2a64c3dccdfaf9084c721b6128382f76 Jun 02 15:27:57.350100 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:57.350067 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-db66h" event={"ID":"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba","Type":"ContainerStarted","Data":"a06738d07c3f9827015e71cbb09af43c2a64c3dccdfaf9084c721b6128382f76"} Jun 02 15:27:58.360154 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:58.360123 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-db66h" event={"ID":"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba","Type":"ContainerStarted","Data":"6e3644d9c262c05e8928cf81f8302a74ae939a79c083216a8299df03a470f2a8"} Jun 02 15:27:58.360154 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:58.360159 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-db66h" event={"ID":"828a0ee4-43b7-46bf-a0ea-f392c9e6c5ba","Type":"ContainerStarted","Data":"49b0a9ff9a22ac08f173d288521f60a5373ed3680320b43f51046936492987b4"} Jun 02 15:27:58.378942 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:27:58.378878 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-db66h" podStartSLOduration=253.445189579 podStartE2EDuration="4m14.378864195s" podCreationTimestamp="2026-06-02 15:23:44 +0000 UTC" firstStartedPulling="2026-06-02 15:27:56.906973181 +0000 UTC m=+252.762893104" lastFinishedPulling="2026-06-02 15:27:57.840647794 +0000 UTC m=+253.696567720" observedRunningTime="2026-06-02 15:27:58.378050079 +0000 UTC m=+254.233970029" watchObservedRunningTime="2026-06-02 15:27:58.378864195 +0000 UTC m=+254.234784151" Jun 02 15:28:13.289151 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289113 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:28:13.289713 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289604 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy" containerID="cri-o://2b00f88bf2896b97191ddb30d32b79027918bd360deecd2fb6588d7750345037" gracePeriod=600 Jun 02 15:28:13.289713 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289600 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="prometheus" containerID="cri-o://02673eff3c73da9f8b92eb9a01c04ddc778a32193f0649cca56dfdf234f6bb89" gracePeriod=600 Jun 02 15:28:13.289713 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289657 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://49ae9f0010fd0d805f4b985ab7a3f81152ecef50b02869d9c1af74722d94eea7" gracePeriod=600 Jun 02 15:28:13.289878 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289726 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="config-reloader" containerID="cri-o://41378eed208325da1ed7b748856c9c52ca086a7cabd83902b86824d1949e9f73" gracePeriod=600 Jun 02 15:28:13.289878 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289670 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-web" containerID="cri-o://1a701321fe0afba42f6b59b6a63fb632826fabdba6fd9bde7412836b1aede5b8" gracePeriod=600 Jun 02 15:28:13.289993 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:13.289860 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="thanos-sidecar" containerID="cri-o://ea50d25ce69339270f51cba81f8f51624c359241e437061f89f2cc53af7f8ae9" gracePeriod=600 Jun 02 15:28:14.408401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408373 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="49ae9f0010fd0d805f4b985ab7a3f81152ecef50b02869d9c1af74722d94eea7" exitCode=0 Jun 02 15:28:14.408401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408397 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="2b00f88bf2896b97191ddb30d32b79027918bd360deecd2fb6588d7750345037" exitCode=0 Jun 02 15:28:14.408401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408404 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="1a701321fe0afba42f6b59b6a63fb632826fabdba6fd9bde7412836b1aede5b8" exitCode=0 Jun 02 15:28:14.408401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408431 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="ea50d25ce69339270f51cba81f8f51624c359241e437061f89f2cc53af7f8ae9" exitCode=0 Jun 02 15:28:14.408401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408440 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="41378eed208325da1ed7b748856c9c52ca086a7cabd83902b86824d1949e9f73" exitCode=0 Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408448 2567 generic.go:358] "Generic (PLEG): container finished" podID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerID="02673eff3c73da9f8b92eb9a01c04ddc778a32193f0649cca56dfdf234f6bb89" exitCode=0 Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408453 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"49ae9f0010fd0d805f4b985ab7a3f81152ecef50b02869d9c1af74722d94eea7"} Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408486 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"2b00f88bf2896b97191ddb30d32b79027918bd360deecd2fb6588d7750345037"} Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408498 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"1a701321fe0afba42f6b59b6a63fb632826fabdba6fd9bde7412836b1aede5b8"} Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408510 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"ea50d25ce69339270f51cba81f8f51624c359241e437061f89f2cc53af7f8ae9"} Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408522 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"41378eed208325da1ed7b748856c9c52ca086a7cabd83902b86824d1949e9f73"} Jun 02 15:28:14.408986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.408534 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"02673eff3c73da9f8b92eb9a01c04ddc778a32193f0649cca56dfdf234f6bb89"} Jun 02 15:28:14.531397 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.531376 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:14.602300 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602223 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-config-out\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602491 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602339 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-metrics-client-certs\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602491 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602373 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-tls-assets\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602491 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602391 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-grpc-tls\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602491 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602432 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602491 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602464 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-rulefiles-0\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602504 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-db\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602537 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-kubelet-serving-ca-bundle\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602563 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-tls\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602589 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-web-config\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602638 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602667 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-metrics-client-ca\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602698 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-thanos-prometheus-http-client-file\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602728 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-545c7\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-kube-api-access-545c7\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.602773 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602759 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-serving-certs-ca-bundle\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.603518 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602790 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-config\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.603518 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602842 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-kube-rbac-proxy\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.603518 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.602871 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-trusted-ca-bundle\") pod \"82561b6c-fb64-4af6-a623-1e019602cc6f\" (UID: \"82561b6c-fb64-4af6-a623-1e019602cc6f\") " Jun 02 15:28:14.603732 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.603705 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:14.604297 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.603904 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:14.604429 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.604340 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:14.604679 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.604552 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:28:14.604679 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.604633 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:14.606644 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.606609 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:28:14.606789 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.606649 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609569 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609592 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609630 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609652 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609667 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609699 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.609714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609711 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-config-out" (OuterVolumeSpecName: "config-out") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 15:28:14.610017 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609732 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-kube-api-access-545c7" (OuterVolumeSpecName: "kube-api-access-545c7") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "kube-api-access-545c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:28:14.610017 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.609838 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-config" (OuterVolumeSpecName: "config") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.610017 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.610006 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.620960 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.620922 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-web-config" (OuterVolumeSpecName: "web-config") pod "82561b6c-fb64-4af6-a623-1e019602cc6f" (UID: "82561b6c-fb64-4af6-a623-1e019602cc6f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 15:28:14.704344 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704318 2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-config-out\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704344 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704341 2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-metrics-client-certs\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704353 2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-tls-assets\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704361 2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-grpc-tls\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704371 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704380 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704389 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-k8s-db\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704397 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704408 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704439 2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-web-config\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704452 2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704461 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-metrics-client-ca\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704470 2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704478 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-545c7\" (UniqueName: \"kubernetes.io/projected/82561b6c-fb64-4af6-a623-1e019602cc6f-kube-api-access-545c7\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704486 2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704496 2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-config\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704504 2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82561b6c-fb64-4af6-a623-1e019602cc6f-secret-kube-rbac-proxy\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:14.704535 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:14.704512 2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82561b6c-fb64-4af6-a623-1e019602cc6f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:28:15.413407 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.413377 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"82561b6c-fb64-4af6-a623-1e019602cc6f","Type":"ContainerDied","Data":"56a70f0329c1effd06cf0607c1882102d467075fbe0ad1c934725224c5893559"} Jun 02 15:28:15.413407 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.413427 2567 scope.go:117] "RemoveContainer" containerID="49ae9f0010fd0d805f4b985ab7a3f81152ecef50b02869d9c1af74722d94eea7" Jun 02 15:28:15.413855 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.413483 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.421510 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.421495 2567 scope.go:117] "RemoveContainer" containerID="2b00f88bf2896b97191ddb30d32b79027918bd360deecd2fb6588d7750345037" Jun 02 15:28:15.428260 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.428243 2567 scope.go:117] "RemoveContainer" containerID="1a701321fe0afba42f6b59b6a63fb632826fabdba6fd9bde7412836b1aede5b8" Jun 02 15:28:15.434475 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.434455 2567 scope.go:117] "RemoveContainer" containerID="ea50d25ce69339270f51cba81f8f51624c359241e437061f89f2cc53af7f8ae9" Jun 02 15:28:15.436469 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.436446 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:28:15.440057 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.440035 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:28:15.442024 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.442005 2567 scope.go:117] "RemoveContainer" containerID="41378eed208325da1ed7b748856c9c52ca086a7cabd83902b86824d1949e9f73" Jun 02 15:28:15.448375 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.448357 2567 scope.go:117] "RemoveContainer" containerID="02673eff3c73da9f8b92eb9a01c04ddc778a32193f0649cca56dfdf234f6bb89" Jun 02 15:28:15.455083 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.455066 2567 scope.go:117] "RemoveContainer" containerID="8377c696460575f5c101365c4e89c1beb342d62ab12536bcb70a4943b7963fc0" Jun 02 15:28:15.472239 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472218 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:28:15.472612 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472598 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="init-config-reloader" Jun 02 15:28:15.472661 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472615 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="init-config-reloader" Jun 02 15:28:15.472661 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472626 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-thanos" Jun 02 15:28:15.472661 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472635 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-thanos" Jun 02 15:28:15.472661 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472645 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" containerName="console" Jun 02 15:28:15.472661 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472653 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" containerName="console" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472662 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="prometheus" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472672 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="prometheus" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472685 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-web" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472693 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-web" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472703 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="thanos-sidecar" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472712 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="thanos-sidecar" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472729 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472736 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472747 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="config-reloader" Jun 02 15:28:15.472807 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472755 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="config-reloader" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472819 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472831 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-thanos" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472842 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="prometheus" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472851 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="kube-rbac-proxy-web" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472860 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="config-reloader" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472869 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" containerName="thanos-sidecar" Jun 02 15:28:15.473073 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.472880 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f4e0420-6408-4c0d-8edd-0fe0c86e3c3d" containerName="console" Jun 02 15:28:15.484257 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.484217 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.486799 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.486778 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 15:28:15.486931 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.486906 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 15:28:15.486931 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.486918 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 15:28:15.487071 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.486922 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h5mj9\"" Jun 02 15:28:15.487071 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.486909 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 15:28:15.487740 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.487262 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 15:28:15.487740 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.487369 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 15:28:15.487740 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.487439 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 15:28:15.488061 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.488044 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bfkusv7v2s8g0\"" Jun 02 15:28:15.488303 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.488287 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 15:28:15.488674 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.488655 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 15:28:15.490011 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.489991 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 15:28:15.490246 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.490225 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 15:28:15.490609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.490588 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:28:15.494306 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.494286 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 15:28:15.509850 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.509832 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.509946 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.509857 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.509946 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.509881 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.509946 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.509900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.509951 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhzm\" (UniqueName: \"kubernetes.io/projected/8e96dcb6-6272-4177-a479-1cfb90717698-kube-api-access-clhzm\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510005 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510068 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510208 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510083 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e96dcb6-6272-4177-a479-1cfb90717698-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510208 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510156 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510290 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510240 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510339 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510306 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510392 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510343 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510392 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510375 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510531 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510403 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e96dcb6-6272-4177-a479-1cfb90717698-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510579 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510486 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510628 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510734 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510700 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.510784 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.510753 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-config\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611173 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611106 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611173 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611139 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clhzm\" (UniqueName: \"kubernetes.io/projected/8e96dcb6-6272-4177-a479-1cfb90717698-kube-api-access-clhzm\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611173 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611166 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611195 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611221 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e96dcb6-6272-4177-a479-1cfb90717698-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611248 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611281 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611406 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611469 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611497 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611529 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e96dcb6-6272-4177-a479-1cfb90717698-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611568 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611565 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611598 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611646 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611690 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-config\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611733 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611743 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.611797 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611759 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.612081 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.611811 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.612741 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.612713 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.613139 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.613119 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.614731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.614514 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.614731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.614542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.614731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.614542 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.614731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.614601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e96dcb6-6272-4177-a479-1cfb90717698-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.615438 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.615388 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.615722 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.615697 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.616033 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.616007 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.616277 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.616205 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.616676 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.616653 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e96dcb6-6272-4177-a479-1cfb90717698-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.616856 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.616839 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e96dcb6-6272-4177-a479-1cfb90717698-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.617122 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.617097 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.617229 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.617211 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.617285 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.617246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.617570 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.617547 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e96dcb6-6272-4177-a479-1cfb90717698-config\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.619597 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.619581 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhzm\" (UniqueName: \"kubernetes.io/projected/8e96dcb6-6272-4177-a479-1cfb90717698-kube-api-access-clhzm\") pod \"prometheus-k8s-0\" (UID: \"8e96dcb6-6272-4177-a479-1cfb90717698\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.795808 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.795780 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:15.951553 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:15.951519 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 15:28:15.955238 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:28:15.955213 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e96dcb6_6272_4177_a479_1cfb90717698.slice/crio-3b16884b0d6541ff434bcf69b3bf449a76cd5484a51b5e6ccd7d31c351f61c66 WatchSource:0}: Error finding container 3b16884b0d6541ff434bcf69b3bf449a76cd5484a51b5e6ccd7d31c351f61c66: Status 404 returned error can't find the container with id 3b16884b0d6541ff434bcf69b3bf449a76cd5484a51b5e6ccd7d31c351f61c66 Jun 02 15:28:16.418534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:16.418503 2567 generic.go:358] "Generic (PLEG): container finished" podID="8e96dcb6-6272-4177-a479-1cfb90717698" containerID="3a9c3a1e8b73571984916dfe733f64da98df96f57763b57495ff7369b6f55c9c" exitCode=0 Jun 02 15:28:16.418893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:16.418589 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerDied","Data":"3a9c3a1e8b73571984916dfe733f64da98df96f57763b57495ff7369b6f55c9c"} Jun 02 15:28:16.418893 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:16.418632 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"3b16884b0d6541ff434bcf69b3bf449a76cd5484a51b5e6ccd7d31c351f61c66"} Jun 02 15:28:16.623887 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:16.623629 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82561b6c-fb64-4af6-a623-1e019602cc6f" path="/var/lib/kubelet/pods/82561b6c-fb64-4af6-a623-1e019602cc6f/volumes" Jun 02 15:28:17.423984 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.423955 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"6d7e50cc6f861159c814faff33f182781c7bac38f656a10787c3730051f16a93"} Jun 02 15:28:17.423984 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.423990 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"6fdc12bcbd64e422b30e722c906054a921764f28c89a54ed49f4dab8465db7ae"} Jun 02 15:28:17.424401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.424000 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"98dae8404933151d3401985cf0630248f739ac2e0dda78f598fea559e2cb9db8"} Jun 02 15:28:17.424401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.424009 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"769160ffb9ba1ce6e10e966f638fae8a0732c69dd547e14b7ca0f74c3c96fe55"} Jun 02 15:28:17.424401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.424019 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"92dc43f174628c2aedbac4a4f45dbc97ec28a38cbfeb6b5e52f9ffcda42d9a1d"} Jun 02 15:28:17.424401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.424027 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e96dcb6-6272-4177-a479-1cfb90717698","Type":"ContainerStarted","Data":"9ec6ad5030f0048ded06fa48ac4a2e6dacc0975dedac611e4b5abef3542ca6f5"} Jun 02 15:28:17.458402 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:17.458358 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.458345227 podStartE2EDuration="2.458345227s" podCreationTimestamp="2026-06-02 15:28:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:28:17.456883706 +0000 UTC m=+273.312803656" watchObservedRunningTime="2026-06-02 15:28:17.458345227 +0000 UTC m=+273.314265172" Jun 02 15:28:20.796226 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:20.796193 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:28:44.584133 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:28:44.584111 2567 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 15:29:15.796727 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:29:15.796683 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:29:15.812910 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:29:15.812887 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:29:16.621494 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:29:16.621468 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 15:33:19.914081 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.914043 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x"] Jun 02 15:33:19.917409 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.917394 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:19.919594 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.919570 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 15:33:19.919724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.919678 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 15:33:19.919795 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.919729 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wtvxv\"" Jun 02 15:33:19.920162 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.920147 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 15:33:19.920259 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.920245 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 15:33:19.944223 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:19.944198 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x"] Jun 02 15:33:20.051741 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.051708 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada03064-93bf-47b0-87c5-1835e91b88bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.051904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.051767 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ada03064-93bf-47b0-87c5-1835e91b88bd-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.051904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.051791 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada03064-93bf-47b0-87c5-1835e91b88bd-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.051904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.051811 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ada03064-93bf-47b0-87c5-1835e91b88bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.051904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.051849 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5chw\" (UniqueName: \"kubernetes.io/projected/ada03064-93bf-47b0-87c5-1835e91b88bd-kube-api-access-h5chw\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.152939 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.152905 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada03064-93bf-47b0-87c5-1835e91b88bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.153127 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.152969 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ada03064-93bf-47b0-87c5-1835e91b88bd-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.153127 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.152993 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada03064-93bf-47b0-87c5-1835e91b88bd-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.153127 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.153022 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ada03064-93bf-47b0-87c5-1835e91b88bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.153127 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.153066 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5chw\" (UniqueName: \"kubernetes.io/projected/ada03064-93bf-47b0-87c5-1835e91b88bd-kube-api-access-h5chw\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.153453 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.153398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ada03064-93bf-47b0-87c5-1835e91b88bd-manifests\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.155470 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.155446 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ada03064-93bf-47b0-87c5-1835e91b88bd-tmp\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.155714 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.155696 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ada03064-93bf-47b0-87c5-1835e91b88bd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.155808 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.155790 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ada03064-93bf-47b0-87c5-1835e91b88bd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.172467 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.172383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5chw\" (UniqueName: \"kubernetes.io/projected/ada03064-93bf-47b0-87c5-1835e91b88bd-kube-api-access-h5chw\") pod \"opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x\" (UID: \"ada03064-93bf-47b0-87c5-1835e91b88bd\") " pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.227450 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.227406 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:20.405686 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.405653 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x"] Jun 02 15:33:20.409611 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:33:20.409582 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada03064_93bf_47b0_87c5_1835e91b88bd.slice/crio-625e64074b6207fc6de93da55d3a14ecad4b5e8c028a972a3ee73ee83e6a1f03 WatchSource:0}: Error finding container 625e64074b6207fc6de93da55d3a14ecad4b5e8c028a972a3ee73ee83e6a1f03: Status 404 returned error can't find the container with id 625e64074b6207fc6de93da55d3a14ecad4b5e8c028a972a3ee73ee83e6a1f03 Jun 02 15:33:20.411188 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:20.411172 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:33:21.300076 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:21.300035 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" event={"ID":"ada03064-93bf-47b0-87c5-1835e91b88bd","Type":"ContainerStarted","Data":"625e64074b6207fc6de93da55d3a14ecad4b5e8c028a972a3ee73ee83e6a1f03"} Jun 02 15:33:24.313033 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:24.313000 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" event={"ID":"ada03064-93bf-47b0-87c5-1835e91b88bd","Type":"ContainerStarted","Data":"8ab1a785c19b059eeeae9c2137ebcb9ad3cd216d04e40b7ad2dd8963c99fc793"} Jun 02 15:33:25.317866 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:25.317833 2567 generic.go:358] "Generic (PLEG): container finished" podID="ada03064-93bf-47b0-87c5-1835e91b88bd" containerID="8ab1a785c19b059eeeae9c2137ebcb9ad3cd216d04e40b7ad2dd8963c99fc793" exitCode=0 Jun 02 15:33:25.318287 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:25.317892 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" event={"ID":"ada03064-93bf-47b0-87c5-1835e91b88bd","Type":"ContainerDied","Data":"8ab1a785c19b059eeeae9c2137ebcb9ad3cd216d04e40b7ad2dd8963c99fc793"} Jun 02 15:33:26.322659 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:26.322620 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" event={"ID":"ada03064-93bf-47b0-87c5-1835e91b88bd","Type":"ContainerStarted","Data":"f39241e30cb26cf6eb67d33bc5d9851771c28640634b13e1b224dfdeab39f26c"} Jun 02 15:33:26.323065 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:26.322734 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:37.328401 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:37.328370 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" Jun 02 15:33:37.358135 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:37.358077 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x" podStartSLOduration=13.084847797 podStartE2EDuration="18.358060818s" podCreationTimestamp="2026-06-02 15:33:19 +0000 UTC" firstStartedPulling="2026-06-02 15:33:20.411291972 +0000 UTC m=+576.267211895" lastFinishedPulling="2026-06-02 15:33:25.68450499 +0000 UTC m=+581.540424916" observedRunningTime="2026-06-02 15:33:26.355100109 +0000 UTC m=+582.211020077" watchObservedRunningTime="2026-06-02 15:33:37.358060818 +0000 UTC m=+593.213980764" Jun 02 15:33:39.956014 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:39.955974 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845"] Jun 02 15:33:39.968319 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:39.968297 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:39.971363 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:39.971341 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 15:33:39.972549 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:39.972524 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xldzm\"" Jun 02 15:33:39.976167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:39.976144 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 15:33:39.977600 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:39.977576 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845"] Jun 02 15:33:40.023428 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.023385 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt859\" (UniqueName: \"kubernetes.io/projected/6dccf40a-c0d0-4a1d-a955-df78de403947-kube-api-access-bt859\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.023542 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.023454 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccf40a-c0d0-4a1d-a955-df78de403947-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.023542 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.023493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dccf40a-c0d0-4a1d-a955-df78de403947-tmp\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.123943 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.123918 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bt859\" (UniqueName: \"kubernetes.io/projected/6dccf40a-c0d0-4a1d-a955-df78de403947-kube-api-access-bt859\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.124098 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.123956 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccf40a-c0d0-4a1d-a955-df78de403947-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.124098 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.123996 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dccf40a-c0d0-4a1d-a955-df78de403947-tmp\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.124216 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:40.124136 2567 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 02 15:33:40.124263 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:40.124219 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dccf40a-c0d0-4a1d-a955-df78de403947-tls-certs podName:6dccf40a-c0d0-4a1d-a955-df78de403947 nodeName:}" failed. No retries permitted until 2026-06-02 15:33:40.624196681 +0000 UTC m=+596.480116617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6dccf40a-c0d0-4a1d-a955-df78de403947-tls-certs") pod "kube-auth-proxy-66bcfb9d8b-4z845" (UID: "6dccf40a-c0d0-4a1d-a955-df78de403947") : secret "kube-auth-proxy-tls" not found Jun 02 15:33:40.126376 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.126358 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6dccf40a-c0d0-4a1d-a955-df78de403947-tmp\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.143582 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.143564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt859\" (UniqueName: \"kubernetes.io/projected/6dccf40a-c0d0-4a1d-a955-df78de403947-kube-api-access-bt859\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.157821 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.157803 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-8nths"] Jun 02 15:33:40.161188 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.161174 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.165646 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.165626 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 15:33:40.165646 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.165641 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mzxz8\"" Jun 02 15:33:40.188180 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.188150 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-8nths"] Jun 02 15:33:40.225052 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.224980 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgjw9\" (UniqueName: \"kubernetes.io/projected/b6c47765-bd4b-46a6-8252-05ff04eaa548-kube-api-access-tgjw9\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.225156 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.225052 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c47765-bd4b-46a6-8252-05ff04eaa548-cert\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.326426 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.326395 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c47765-bd4b-46a6-8252-05ff04eaa548-cert\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.326558 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.326513 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgjw9\" (UniqueName: \"kubernetes.io/projected/b6c47765-bd4b-46a6-8252-05ff04eaa548-kube-api-access-tgjw9\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.326558 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:40.326539 2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 15:33:40.326627 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:40.326611 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c47765-bd4b-46a6-8252-05ff04eaa548-cert podName:b6c47765-bd4b-46a6-8252-05ff04eaa548 nodeName:}" failed. No retries permitted until 2026-06-02 15:33:40.826590555 +0000 UTC m=+596.682510479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6c47765-bd4b-46a6-8252-05ff04eaa548-cert") pod "odh-model-controller-76588b95-8nths" (UID: "b6c47765-bd4b-46a6-8252-05ff04eaa548") : secret "odh-model-controller-webhook-cert" not found Jun 02 15:33:40.344921 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.344902 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgjw9\" (UniqueName: \"kubernetes.io/projected/b6c47765-bd4b-46a6-8252-05ff04eaa548-kube-api-access-tgjw9\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.629194 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.629167 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccf40a-c0d0-4a1d-a955-df78de403947-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.631652 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.631629 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccf40a-c0d0-4a1d-a955-df78de403947-tls-certs\") pod \"kube-auth-proxy-66bcfb9d8b-4z845\" (UID: \"6dccf40a-c0d0-4a1d-a955-df78de403947\") " pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:40.830368 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.830335 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c47765-bd4b-46a6-8252-05ff04eaa548-cert\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.832654 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.832630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6c47765-bd4b-46a6-8252-05ff04eaa548-cert\") pod \"odh-model-controller-76588b95-8nths\" (UID: \"b6c47765-bd4b-46a6-8252-05ff04eaa548\") " pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:40.879186 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:40.879160 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" Jun 02 15:33:41.052906 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:33:41.052874 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dccf40a_c0d0_4a1d_a955_df78de403947.slice/crio-f81ddc1243aeb5e62e795c129c9f35ad515c0c8b5c087738cf4e291b841173eb WatchSource:0}: Error finding container f81ddc1243aeb5e62e795c129c9f35ad515c0c8b5c087738cf4e291b841173eb: Status 404 returned error can't find the container with id f81ddc1243aeb5e62e795c129c9f35ad515c0c8b5c087738cf4e291b841173eb Jun 02 15:33:41.053458 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:41.053435 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845"] Jun 02 15:33:41.072054 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:41.072028 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:41.245104 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:41.245074 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-8nths"] Jun 02 15:33:41.247618 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:33:41.247595 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c47765_bd4b_46a6_8252_05ff04eaa548.slice/crio-de726e7cc90245f62a2c8d2230eb90f7f52e37523baacb877d733525b54d7c97 WatchSource:0}: Error finding container de726e7cc90245f62a2c8d2230eb90f7f52e37523baacb877d733525b54d7c97: Status 404 returned error can't find the container with id de726e7cc90245f62a2c8d2230eb90f7f52e37523baacb877d733525b54d7c97 Jun 02 15:33:41.371428 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:41.371382 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" event={"ID":"6dccf40a-c0d0-4a1d-a955-df78de403947","Type":"ContainerStarted","Data":"f81ddc1243aeb5e62e795c129c9f35ad515c0c8b5c087738cf4e291b841173eb"} Jun 02 15:33:41.372313 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:41.372284 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-8nths" event={"ID":"b6c47765-bd4b-46a6-8252-05ff04eaa548","Type":"ContainerStarted","Data":"de726e7cc90245f62a2c8d2230eb90f7f52e37523baacb877d733525b54d7c97"} Jun 02 15:33:42.003974 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.003883 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-584cx"] Jun 02 15:33:42.007779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.007752 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.010758 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.010576 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 15:33:42.017766 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.017743 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-584cx"] Jun 02 15:33:42.039986 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.039957 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlgxk\" (UniqueName: \"kubernetes.io/projected/293789e3-05bf-47bc-94e8-20a51d4a51e7-kube-api-access-xlgxk\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.040108 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.040013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293789e3-05bf-47bc-94e8-20a51d4a51e7-tls-certs\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.140990 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.140955 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlgxk\" (UniqueName: \"kubernetes.io/projected/293789e3-05bf-47bc-94e8-20a51d4a51e7-kube-api-access-xlgxk\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.141442 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.141045 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293789e3-05bf-47bc-94e8-20a51d4a51e7-tls-certs\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.141442 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:42.141339 2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 15:33:42.141442 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:42.141425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293789e3-05bf-47bc-94e8-20a51d4a51e7-tls-certs podName:293789e3-05bf-47bc-94e8-20a51d4a51e7 nodeName:}" failed. No retries permitted until 2026-06-02 15:33:42.641388109 +0000 UTC m=+598.497308047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/293789e3-05bf-47bc-94e8-20a51d4a51e7-tls-certs") pod "model-serving-api-6577596cd5-584cx" (UID: "293789e3-05bf-47bc-94e8-20a51d4a51e7") : secret "model-serving-api-tls" not found Jun 02 15:33:42.164677 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.164626 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlgxk\" (UniqueName: \"kubernetes.io/projected/293789e3-05bf-47bc-94e8-20a51d4a51e7-kube-api-access-xlgxk\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.646377 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.646337 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293789e3-05bf-47bc-94e8-20a51d4a51e7-tls-certs\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.649655 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.649612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/293789e3-05bf-47bc-94e8-20a51d4a51e7-tls-certs\") pod \"model-serving-api-6577596cd5-584cx\" (UID: \"293789e3-05bf-47bc-94e8-20a51d4a51e7\") " pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:42.927737 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:42.927656 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:44.975540 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:44.975508 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 15:33:45.084280 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.084220 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-584cx"] Jun 02 15:33:45.087846 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:33:45.087819 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293789e3_05bf_47bc_94e8_20a51d4a51e7.slice/crio-9b1847a4b6f15ba9f500d768e4c1479b734c18a701fd0799be0d57d0976ae433 WatchSource:0}: Error finding container 9b1847a4b6f15ba9f500d768e4c1479b734c18a701fd0799be0d57d0976ae433: Status 404 returned error can't find the container with id 9b1847a4b6f15ba9f500d768e4c1479b734c18a701fd0799be0d57d0976ae433 Jun 02 15:33:45.389188 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.389154 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" event={"ID":"6dccf40a-c0d0-4a1d-a955-df78de403947","Type":"ContainerStarted","Data":"9fea6d2969c1db0c7529f063ca4080cfd0485137b86815e79e51bbe3801cb7c2"} Jun 02 15:33:45.390337 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.390303 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-584cx" event={"ID":"293789e3-05bf-47bc-94e8-20a51d4a51e7","Type":"ContainerStarted","Data":"9b1847a4b6f15ba9f500d768e4c1479b734c18a701fd0799be0d57d0976ae433"} Jun 02 15:33:45.391570 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.391547 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-8nths" event={"ID":"b6c47765-bd4b-46a6-8252-05ff04eaa548","Type":"ContainerStarted","Data":"cef76452cf7060e6479efda4d270274fbe9631fd26670bef677b144fb03a9e40"} Jun 02 15:33:45.391685 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.391671 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:45.407779 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.407739 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66bcfb9d8b-4z845" podStartSLOduration=2.489236426 podStartE2EDuration="6.407725235s" podCreationTimestamp="2026-06-02 15:33:39 +0000 UTC" firstStartedPulling="2026-06-02 15:33:41.054552759 +0000 UTC m=+596.910472682" lastFinishedPulling="2026-06-02 15:33:44.973041554 +0000 UTC m=+600.828961491" observedRunningTime="2026-06-02 15:33:45.406546994 +0000 UTC m=+601.262466939" watchObservedRunningTime="2026-06-02 15:33:45.407725235 +0000 UTC m=+601.263645179" Jun 02 15:33:45.426502 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:45.426452 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-8nths" podStartSLOduration=1.693026973 podStartE2EDuration="5.426435181s" podCreationTimestamp="2026-06-02 15:33:40 +0000 UTC" firstStartedPulling="2026-06-02 15:33:41.249332831 +0000 UTC m=+597.105252754" lastFinishedPulling="2026-06-02 15:33:44.982741024 +0000 UTC m=+600.838660962" observedRunningTime="2026-06-02 15:33:45.424022482 +0000 UTC m=+601.279942428" watchObservedRunningTime="2026-06-02 15:33:45.426435181 +0000 UTC m=+601.282355127" Jun 02 15:33:48.402658 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:48.402623 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-584cx" event={"ID":"293789e3-05bf-47bc-94e8-20a51d4a51e7","Type":"ContainerStarted","Data":"330ee83c6dd0c0a1f4ce9b2e9c74d3bd10cfb04f35116c9485e9285ed8db1fce"} Jun 02 15:33:48.403020 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:48.402872 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:53.126585 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.126481 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-584cx" podStartSLOduration=9.711956285 podStartE2EDuration="12.126465132s" podCreationTimestamp="2026-06-02 15:33:41 +0000 UTC" firstStartedPulling="2026-06-02 15:33:45.089578364 +0000 UTC m=+600.945498289" lastFinishedPulling="2026-06-02 15:33:47.504087211 +0000 UTC m=+603.360007136" observedRunningTime="2026-06-02 15:33:48.424500931 +0000 UTC m=+604.280420873" watchObservedRunningTime="2026-06-02 15:33:53.126465132 +0000 UTC m=+608.982385079" Jun 02 15:33:53.127476 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.127458 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t"] Jun 02 15:33:53.130765 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.130750 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.133565 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.133545 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 15:33:53.134178 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.134155 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-78ppn\"" Jun 02 15:33:53.148060 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.148022 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-v468f"] Jun 02 15:33:53.151609 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.151590 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.155153 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.155135 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-76sqk\"" Jun 02 15:33:53.155574 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.155558 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 15:33:53.161585 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.161561 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t"] Jun 02 15:33:53.176136 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.176114 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-v468f"] Jun 02 15:33:53.241064 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.241040 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbn6n\" (UniqueName: \"kubernetes.io/projected/1b945f2b-8b68-495d-9cd8-281904c25ad3-kube-api-access-bbn6n\") pod \"llmisvc-controller-manager-c6b9847d7-v468f\" (UID: \"1b945f2b-8b68-495d-9cd8-281904c25ad3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.241184 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.241095 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.241184 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.241111 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b945f2b-8b68-495d-9cd8-281904c25ad3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-v468f\" (UID: \"1b945f2b-8b68-495d-9cd8-281904c25ad3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.241298 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.241201 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6gkt\" (UniqueName: \"kubernetes.io/projected/29676aba-c502-4031-bd88-9f659da307d0-kube-api-access-c6gkt\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.342594 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.342560 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.342594 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.342596 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b945f2b-8b68-495d-9cd8-281904c25ad3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-v468f\" (UID: \"1b945f2b-8b68-495d-9cd8-281904c25ad3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.342808 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.342632 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6gkt\" (UniqueName: \"kubernetes.io/projected/29676aba-c502-4031-bd88-9f659da307d0-kube-api-access-c6gkt\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.342808 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:53.342717 2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 15:33:53.342808 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.342764 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbn6n\" (UniqueName: \"kubernetes.io/projected/1b945f2b-8b68-495d-9cd8-281904c25ad3-kube-api-access-bbn6n\") pod \"llmisvc-controller-manager-c6b9847d7-v468f\" (UID: \"1b945f2b-8b68-495d-9cd8-281904c25ad3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.342808 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:53.342777 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert podName:29676aba-c502-4031-bd88-9f659da307d0 nodeName:}" failed. No retries permitted until 2026-06-02 15:33:53.84275869 +0000 UTC m=+609.698678619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert") pod "kserve-controller-manager-7c99ffcdcd-9xl8t" (UID: "29676aba-c502-4031-bd88-9f659da307d0") : secret "kserve-webhook-server-cert" not found Jun 02 15:33:53.345248 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.345226 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b945f2b-8b68-495d-9cd8-281904c25ad3-cert\") pod \"llmisvc-controller-manager-c6b9847d7-v468f\" (UID: \"1b945f2b-8b68-495d-9cd8-281904c25ad3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.363538 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.363516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6gkt\" (UniqueName: \"kubernetes.io/projected/29676aba-c502-4031-bd88-9f659da307d0-kube-api-access-c6gkt\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.365188 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.365166 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbn6n\" (UniqueName: \"kubernetes.io/projected/1b945f2b-8b68-495d-9cd8-281904c25ad3-kube-api-access-bbn6n\") pod \"llmisvc-controller-manager-c6b9847d7-v468f\" (UID: \"1b945f2b-8b68-495d-9cd8-281904c25ad3\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.460800 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.460714 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:53.631437 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.626302 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-v468f"] Jun 02 15:33:53.634140 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:33:53.634108 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b945f2b_8b68_495d_9cd8_281904c25ad3.slice/crio-51005a2f48654ffa0f7e5075a82136d47067f6160fac0db5cb3f47179be99c8b WatchSource:0}: Error finding container 51005a2f48654ffa0f7e5075a82136d47067f6160fac0db5cb3f47179be99c8b: Status 404 returned error can't find the container with id 51005a2f48654ffa0f7e5075a82136d47067f6160fac0db5cb3f47179be99c8b Jun 02 15:33:53.848052 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:53.848012 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:53.848226 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:53.848157 2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 15:33:53.848226 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:33:53.848221 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert podName:29676aba-c502-4031-bd88-9f659da307d0 nodeName:}" failed. No retries permitted until 2026-06-02 15:33:54.848205102 +0000 UTC m=+610.704125028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert") pod "kserve-controller-manager-7c99ffcdcd-9xl8t" (UID: "29676aba-c502-4031-bd88-9f659da307d0") : secret "kserve-webhook-server-cert" not found Jun 02 15:33:54.428717 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:54.428682 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" event={"ID":"1b945f2b-8b68-495d-9cd8-281904c25ad3","Type":"ContainerStarted","Data":"51005a2f48654ffa0f7e5075a82136d47067f6160fac0db5cb3f47179be99c8b"} Jun 02 15:33:54.857391 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:54.857355 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:54.860063 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:54.860038 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29676aba-c502-4031-bd88-9f659da307d0-cert\") pod \"kserve-controller-manager-7c99ffcdcd-9xl8t\" (UID: \"29676aba-c502-4031-bd88-9f659da307d0\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:54.940546 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:54.940506 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:55.160392 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:55.160306 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t"] Jun 02 15:33:55.164897 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:33:55.164869 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29676aba_c502_4031_bd88_9f659da307d0.slice/crio-bf438322926c852374e11cef6f406b2d885a3766b460b78fb7289eb694020490 WatchSource:0}: Error finding container bf438322926c852374e11cef6f406b2d885a3766b460b78fb7289eb694020490: Status 404 returned error can't find the container with id bf438322926c852374e11cef6f406b2d885a3766b460b78fb7289eb694020490 Jun 02 15:33:55.433667 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:55.433584 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" event={"ID":"29676aba-c502-4031-bd88-9f659da307d0","Type":"ContainerStarted","Data":"bf438322926c852374e11cef6f406b2d885a3766b460b78fb7289eb694020490"} Jun 02 15:33:56.396982 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:56.396942 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-8nths" Jun 02 15:33:57.442347 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:57.442313 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" event={"ID":"1b945f2b-8b68-495d-9cd8-281904c25ad3","Type":"ContainerStarted","Data":"66cce6dae6667254538a7482bbdaba4d8761de168a12752fdfdbfc1988b309df"} Jun 02 15:33:57.442756 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:57.442431 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:33:59.410980 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:59.410950 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-584cx" Jun 02 15:33:59.449523 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:59.449488 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" event={"ID":"29676aba-c502-4031-bd88-9f659da307d0","Type":"ContainerStarted","Data":"a1648489b9948b319a3e6af2e3c63669dff877004e03d843e4e770fd202e87a1"} Jun 02 15:33:59.449850 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:59.449618 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:33:59.451913 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:33:59.451868 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" podStartSLOduration=2.825946031 podStartE2EDuration="6.451856772s" podCreationTimestamp="2026-06-02 15:33:53 +0000 UTC" firstStartedPulling="2026-06-02 15:33:53.634933845 +0000 UTC m=+609.490853769" lastFinishedPulling="2026-06-02 15:33:57.260844587 +0000 UTC m=+613.116764510" observedRunningTime="2026-06-02 15:33:57.735245425 +0000 UTC m=+613.591165372" watchObservedRunningTime="2026-06-02 15:33:59.451856772 +0000 UTC m=+615.307776750" Jun 02 15:34:02.844827 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.844779 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" podStartSLOduration=6.602792069 podStartE2EDuration="9.844764505s" podCreationTimestamp="2026-06-02 15:33:53 +0000 UTC" firstStartedPulling="2026-06-02 15:33:55.166234903 +0000 UTC m=+611.022154826" lastFinishedPulling="2026-06-02 15:33:58.408207337 +0000 UTC m=+614.264127262" observedRunningTime="2026-06-02 15:33:59.482118805 +0000 UTC m=+615.338038750" watchObservedRunningTime="2026-06-02 15:34:02.844764505 +0000 UTC m=+618.700684450" Jun 02 15:34:02.846198 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.846177 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb"] Jun 02 15:34:02.849654 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.849640 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:02.854460 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.854440 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 15:34:02.854591 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.854460 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 15:34:02.868710 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.868693 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-xttqn\"" Jun 02 15:34:02.944041 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.944007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvv4\" (UniqueName: \"kubernetes.io/projected/2b218682-f754-4836-b92e-868a235ab51a-kube-api-access-6wvv4\") pod \"servicemesh-operator3-55f49c5f94-j2mqb\" (UID: \"2b218682-f754-4836-b92e-868a235ab51a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:02.944187 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.944077 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2b218682-f754-4836-b92e-868a235ab51a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-j2mqb\" (UID: \"2b218682-f754-4836-b92e-868a235ab51a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:02.999527 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:02.999496 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb"] Jun 02 15:34:03.044694 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.044666 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvv4\" (UniqueName: \"kubernetes.io/projected/2b218682-f754-4836-b92e-868a235ab51a-kube-api-access-6wvv4\") pod \"servicemesh-operator3-55f49c5f94-j2mqb\" (UID: \"2b218682-f754-4836-b92e-868a235ab51a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:03.044819 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.044727 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2b218682-f754-4836-b92e-868a235ab51a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-j2mqb\" (UID: \"2b218682-f754-4836-b92e-868a235ab51a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:03.047360 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.047338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2b218682-f754-4836-b92e-868a235ab51a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-j2mqb\" (UID: \"2b218682-f754-4836-b92e-868a235ab51a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:03.062030 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.061996 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvv4\" (UniqueName: \"kubernetes.io/projected/2b218682-f754-4836-b92e-868a235ab51a-kube-api-access-6wvv4\") pod \"servicemesh-operator3-55f49c5f94-j2mqb\" (UID: \"2b218682-f754-4836-b92e-868a235ab51a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:03.159197 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.159135 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:03.307728 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.307698 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb"] Jun 02 15:34:03.308057 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:34:03.308029 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b218682_f754_4836_b92e_868a235ab51a.slice/crio-c7065c10d425c4120c9f2168c5a65e36548ea6530fb9ce4e15ab1775ee8114e9 WatchSource:0}: Error finding container c7065c10d425c4120c9f2168c5a65e36548ea6530fb9ce4e15ab1775ee8114e9: Status 404 returned error can't find the container with id c7065c10d425c4120c9f2168c5a65e36548ea6530fb9ce4e15ab1775ee8114e9 Jun 02 15:34:03.469527 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:03.469433 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" event={"ID":"2b218682-f754-4836-b92e-868a235ab51a","Type":"ContainerStarted","Data":"c7065c10d425c4120c9f2168c5a65e36548ea6530fb9ce4e15ab1775ee8114e9"} Jun 02 15:34:06.481456 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:06.481391 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" event={"ID":"2b218682-f754-4836-b92e-868a235ab51a","Type":"ContainerStarted","Data":"b46331efd626bb4e28c38a25028c10a6da3e4afcb7aa772b8f760a9f9a486411"} Jun 02 15:34:06.481929 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:06.481566 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:06.506705 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:06.506655 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" podStartSLOduration=2.278078926 podStartE2EDuration="4.506639173s" podCreationTimestamp="2026-06-02 15:34:02 +0000 UTC" firstStartedPulling="2026-06-02 15:34:03.310612782 +0000 UTC m=+619.166532705" lastFinishedPulling="2026-06-02 15:34:05.539173029 +0000 UTC m=+621.395092952" observedRunningTime="2026-06-02 15:34:06.504554527 +0000 UTC m=+622.360474472" watchObservedRunningTime="2026-06-02 15:34:06.506639173 +0000 UTC m=+622.362559119" Jun 02 15:34:16.027485 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.027437 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-756bd9f55b-6nrpx"] Jun 02 15:34:16.031051 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.031027 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.033453 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.033396 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 15:34:16.033563 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.033507 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xm97d\"" Jun 02 15:34:16.037830 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.037805 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-756bd9f55b-6nrpx"] Jun 02 15:34:16.158731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.158693 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzwqz\" (UniqueName: \"kubernetes.io/projected/3d064a13-c126-42c8-9d15-0cb6f6cd4670-kube-api-access-jzwqz\") pod \"dashboard-redirect-756bd9f55b-6nrpx\" (UID: \"3d064a13-c126-42c8-9d15-0cb6f6cd4670\") " pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.158892 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.158760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3d064a13-c126-42c8-9d15-0cb6f6cd4670-redirect-config\") pod \"dashboard-redirect-756bd9f55b-6nrpx\" (UID: \"3d064a13-c126-42c8-9d15-0cb6f6cd4670\") " pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.259357 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.259328 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzwqz\" (UniqueName: \"kubernetes.io/projected/3d064a13-c126-42c8-9d15-0cb6f6cd4670-kube-api-access-jzwqz\") pod \"dashboard-redirect-756bd9f55b-6nrpx\" (UID: \"3d064a13-c126-42c8-9d15-0cb6f6cd4670\") " pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.259579 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.259388 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3d064a13-c126-42c8-9d15-0cb6f6cd4670-redirect-config\") pod \"dashboard-redirect-756bd9f55b-6nrpx\" (UID: \"3d064a13-c126-42c8-9d15-0cb6f6cd4670\") " pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.260041 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.260024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3d064a13-c126-42c8-9d15-0cb6f6cd4670-redirect-config\") pod \"dashboard-redirect-756bd9f55b-6nrpx\" (UID: \"3d064a13-c126-42c8-9d15-0cb6f6cd4670\") " pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.278929 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.278868 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzwqz\" (UniqueName: \"kubernetes.io/projected/3d064a13-c126-42c8-9d15-0cb6f6cd4670-kube-api-access-jzwqz\") pod \"dashboard-redirect-756bd9f55b-6nrpx\" (UID: \"3d064a13-c126-42c8-9d15-0cb6f6cd4670\") " pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.342731 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.342693 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" Jun 02 15:34:16.472540 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.472510 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-756bd9f55b-6nrpx"] Jun 02 15:34:16.476037 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:34:16.476006 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d064a13_c126_42c8_9d15_0cb6f6cd4670.slice/crio-068a13d92634fc11cf126ef701dbf642929189ba040f4eaca3e517bf695cc3c6 WatchSource:0}: Error finding container 068a13d92634fc11cf126ef701dbf642929189ba040f4eaca3e517bf695cc3c6: Status 404 returned error can't find the container with id 068a13d92634fc11cf126ef701dbf642929189ba040f4eaca3e517bf695cc3c6 Jun 02 15:34:16.520237 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:16.520213 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" event={"ID":"3d064a13-c126-42c8-9d15-0cb6f6cd4670","Type":"ContainerStarted","Data":"068a13d92634fc11cf126ef701dbf642929189ba040f4eaca3e517bf695cc3c6"} Jun 02 15:34:17.488093 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:17.488040 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-j2mqb" Jun 02 15:34:19.532729 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:19.532698 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" event={"ID":"3d064a13-c126-42c8-9d15-0cb6f6cd4670","Type":"ContainerStarted","Data":"23579146b121a3b532d34eee0de44d545b93a84a3825bcf41d94678130031ebd"} Jun 02 15:34:19.557571 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:19.557527 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-756bd9f55b-6nrpx" podStartSLOduration=0.701567695 podStartE2EDuration="3.557514037s" podCreationTimestamp="2026-06-02 15:34:16 +0000 UTC" firstStartedPulling="2026-06-02 15:34:16.477447066 +0000 UTC m=+632.333366988" lastFinishedPulling="2026-06-02 15:34:19.333393408 +0000 UTC m=+635.189313330" observedRunningTime="2026-06-02 15:34:19.555641389 +0000 UTC m=+635.411561334" watchObservedRunningTime="2026-06-02 15:34:19.557514037 +0000 UTC m=+635.413433982" Jun 02 15:34:28.447962 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.447930 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-v468f" Jun 02 15:34:28.739222 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.739191 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw"] Jun 02 15:34:28.746049 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.746027 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.748379 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.748354 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 15:34:28.748490 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.748382 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 15:34:28.748490 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.748356 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j97zq\"" Jun 02 15:34:28.748944 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.748651 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 15:34:28.748944 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.748655 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 15:34:28.756134 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.756114 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw"] Jun 02 15:34:28.768529 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.768506 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.768712 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.768686 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtsw5\" (UniqueName: \"kubernetes.io/projected/edba82d0-4b5b-4575-a078-352f9b01c22a-kube-api-access-dtsw5\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.768855 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.768751 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.768855 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.768792 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.768855 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.768837 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.769010 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.768872 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edba82d0-4b5b-4575-a078-352f9b01c22a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.769057 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.769013 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.869824 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.869794 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dtsw5\" (UniqueName: \"kubernetes.io/projected/edba82d0-4b5b-4575-a078-352f9b01c22a-kube-api-access-dtsw5\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.869952 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.869845 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.869952 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.869883 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.869952 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.869926 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.870085 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.869965 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edba82d0-4b5b-4575-a078-352f9b01c22a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.870085 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.870010 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.870085 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.870051 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.870904 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.870876 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.872513 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.872485 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edba82d0-4b5b-4575-a078-352f9b01c22a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.872513 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.872502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.872688 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.872593 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.872688 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.872670 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.877929 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.877907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edba82d0-4b5b-4575-a078-352f9b01c22a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:28.878203 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:28.878185 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtsw5\" (UniqueName: \"kubernetes.io/projected/edba82d0-4b5b-4575-a078-352f9b01c22a-kube-api-access-dtsw5\") pod \"istiod-openshift-gateway-798958bb55-lb7sw\" (UID: \"edba82d0-4b5b-4575-a078-352f9b01c22a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:29.056921 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:29.056836 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:29.195237 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:29.195204 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw"] Jun 02 15:34:29.197556 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:34:29.197522 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedba82d0_4b5b_4575_a078_352f9b01c22a.slice/crio-43f8904ea7976bd38404c78f994bed71392478fa3b48b11faf95c932640fbd3a WatchSource:0}: Error finding container 43f8904ea7976bd38404c78f994bed71392478fa3b48b11faf95c932640fbd3a: Status 404 returned error can't find the container with id 43f8904ea7976bd38404c78f994bed71392478fa3b48b11faf95c932640fbd3a Jun 02 15:34:29.570359 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:29.570315 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" event={"ID":"edba82d0-4b5b-4575-a078-352f9b01c22a","Type":"ContainerStarted","Data":"43f8904ea7976bd38404c78f994bed71392478fa3b48b11faf95c932640fbd3a"} Jun 02 15:34:30.459223 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:30.459192 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-9xl8t" Jun 02 15:34:32.316155 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:32.316119 2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 02 15:34:32.316434 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:32.316191 2567 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 02 15:34:32.582825 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:32.582738 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" event={"ID":"edba82d0-4b5b-4575-a078-352f9b01c22a","Type":"ContainerStarted","Data":"369dbaa643266c843709b1edb88b5b9ced5f14363e56688f0cd5a12f3c2c5ccf"} Jun 02 15:34:32.582988 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:32.582824 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:34:32.612832 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:32.612787 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" podStartSLOduration=1.4971469339999999 podStartE2EDuration="4.612772045s" podCreationTimestamp="2026-06-02 15:34:28 +0000 UTC" firstStartedPulling="2026-06-02 15:34:29.200217524 +0000 UTC m=+645.056137462" lastFinishedPulling="2026-06-02 15:34:32.31584265 +0000 UTC m=+648.171762573" observedRunningTime="2026-06-02 15:34:32.611458719 +0000 UTC m=+648.467378663" watchObservedRunningTime="2026-06-02 15:34:32.612772045 +0000 UTC m=+648.468691990" Jun 02 15:34:33.589377 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:34:33.589345 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lb7sw" Jun 02 15:35:24.981151 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:24.981111 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh"] Jun 02 15:35:24.984477 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:24.984460 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:24.987356 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:24.987335 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 15:35:24.999168 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:24.999145 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6qjq6\"" Jun 02 15:35:24.999588 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:24.999570 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 15:35:25.001508 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.001489 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh"] Jun 02 15:35:25.060602 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.060539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9hc\" (UniqueName: \"kubernetes.io/projected/25bc5205-c0a0-4d79-9db1-70415cc6082d-kube-api-access-df9hc\") pod \"limitador-operator-controller-manager-85c4996f8c-bbfhh\" (UID: \"25bc5205-c0a0-4d79-9db1-70415cc6082d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:25.161814 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.161783 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df9hc\" (UniqueName: \"kubernetes.io/projected/25bc5205-c0a0-4d79-9db1-70415cc6082d-kube-api-access-df9hc\") pod \"limitador-operator-controller-manager-85c4996f8c-bbfhh\" (UID: \"25bc5205-c0a0-4d79-9db1-70415cc6082d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:25.182599 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.182578 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9hc\" (UniqueName: \"kubernetes.io/projected/25bc5205-c0a0-4d79-9db1-70415cc6082d-kube-api-access-df9hc\") pod \"limitador-operator-controller-manager-85c4996f8c-bbfhh\" (UID: \"25bc5205-c0a0-4d79-9db1-70415cc6082d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:25.294616 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.294582 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:25.437982 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.437913 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh"] Jun 02 15:35:25.440616 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:35:25.440583 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25bc5205_c0a0_4d79_9db1_70415cc6082d.slice/crio-c04d874719459d3ab36434ba3a6143a27d5090cea65ee5a6c3c02557a11226d9 WatchSource:0}: Error finding container c04d874719459d3ab36434ba3a6143a27d5090cea65ee5a6c3c02557a11226d9: Status 404 returned error can't find the container with id c04d874719459d3ab36434ba3a6143a27d5090cea65ee5a6c3c02557a11226d9 Jun 02 15:35:25.762847 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:25.762810 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" event={"ID":"25bc5205-c0a0-4d79-9db1-70415cc6082d","Type":"ContainerStarted","Data":"c04d874719459d3ab36434ba3a6143a27d5090cea65ee5a6c3c02557a11226d9"} Jun 02 15:35:27.772881 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:27.772840 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" event={"ID":"25bc5205-c0a0-4d79-9db1-70415cc6082d","Type":"ContainerStarted","Data":"9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a"} Jun 02 15:35:27.773260 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:27.772959 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:27.799370 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:27.799326 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" podStartSLOduration=1.941132437 podStartE2EDuration="3.799313546s" podCreationTimestamp="2026-06-02 15:35:24 +0000 UTC" firstStartedPulling="2026-06-02 15:35:25.443078184 +0000 UTC m=+701.298998114" lastFinishedPulling="2026-06-02 15:35:27.301259301 +0000 UTC m=+703.157179223" observedRunningTime="2026-06-02 15:35:27.796655868 +0000 UTC m=+703.652575813" watchObservedRunningTime="2026-06-02 15:35:27.799313546 +0000 UTC m=+703.655233490" Jun 02 15:35:38.779545 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:38.779516 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:39.549993 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.549953 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh"] Jun 02 15:35:39.550263 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.550198 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" containerName="manager" containerID="cri-o://9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a" gracePeriod=2 Jun 02 15:35:39.590447 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.590401 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh"] Jun 02 15:35:39.648544 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.648515 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52"] Jun 02 15:35:39.648881 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.648868 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" containerName="manager" Jun 02 15:35:39.648881 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.648881 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" containerName="manager" Jun 02 15:35:39.648999 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.648943 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" containerName="manager" Jun 02 15:35:39.651768 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.651751 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:35:39.689397 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.689366 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52"] Jun 02 15:35:39.787055 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.787034 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:39.791635 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.791609 2567 status_manager.go:895] "Failed to get status for pod" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" err="pods \"limitador-operator-controller-manager-85c4996f8c-bbfhh\" is forbidden: User \"system:node:ip-10-0-136-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-206.ec2.internal' and this object" Jun 02 15:35:39.793005 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.792984 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq88w\" (UniqueName: \"kubernetes.io/projected/5be24646-a1ac-4a0a-906f-8be44cb6ba31-kube-api-access-jq88w\") pod \"limitador-operator-controller-manager-85c4996f8c-wsm52\" (UID: \"5be24646-a1ac-4a0a-906f-8be44cb6ba31\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:35:39.821230 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.821174 2567 generic.go:358] "Generic (PLEG): container finished" podID="25bc5205-c0a0-4d79-9db1-70415cc6082d" containerID="9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a" exitCode=0 Jun 02 15:35:39.821230 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.821215 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" Jun 02 15:35:39.821349 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.821239 2567 scope.go:117] "RemoveContainer" containerID="9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a" Jun 02 15:35:39.823328 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.823307 2567 status_manager.go:895] "Failed to get status for pod" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" err="pods \"limitador-operator-controller-manager-85c4996f8c-bbfhh\" is forbidden: User \"system:node:ip-10-0-136-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-206.ec2.internal' and this object" Jun 02 15:35:39.829523 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.829506 2567 scope.go:117] "RemoveContainer" containerID="9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a" Jun 02 15:35:39.829783 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:35:39.829766 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a\": container with ID starting with 9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a not found: ID does not exist" containerID="9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a" Jun 02 15:35:39.829827 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.829792 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a"} err="failed to get container status \"9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a\": rpc error: code = NotFound desc = could not find container \"9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a\": container with ID starting with 9f49af0162794febf45d7bc4e047784af290f0d6c7a85f29c6c1a97940dbda2a not found: ID does not exist" Jun 02 15:35:39.894332 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.894305 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df9hc\" (UniqueName: \"kubernetes.io/projected/25bc5205-c0a0-4d79-9db1-70415cc6082d-kube-api-access-df9hc\") pod \"25bc5205-c0a0-4d79-9db1-70415cc6082d\" (UID: \"25bc5205-c0a0-4d79-9db1-70415cc6082d\") " Jun 02 15:35:39.894468 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.894452 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jq88w\" (UniqueName: \"kubernetes.io/projected/5be24646-a1ac-4a0a-906f-8be44cb6ba31-kube-api-access-jq88w\") pod \"limitador-operator-controller-manager-85c4996f8c-wsm52\" (UID: \"5be24646-a1ac-4a0a-906f-8be44cb6ba31\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:35:39.896610 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.896586 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25bc5205-c0a0-4d79-9db1-70415cc6082d-kube-api-access-df9hc" (OuterVolumeSpecName: "kube-api-access-df9hc") pod "25bc5205-c0a0-4d79-9db1-70415cc6082d" (UID: "25bc5205-c0a0-4d79-9db1-70415cc6082d"). InnerVolumeSpecName "kube-api-access-df9hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:35:39.905206 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.905185 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq88w\" (UniqueName: \"kubernetes.io/projected/5be24646-a1ac-4a0a-906f-8be44cb6ba31-kube-api-access-jq88w\") pod \"limitador-operator-controller-manager-85c4996f8c-wsm52\" (UID: \"5be24646-a1ac-4a0a-906f-8be44cb6ba31\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:35:39.963135 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.963102 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:35:39.995224 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:39.995191 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df9hc\" (UniqueName: \"kubernetes.io/projected/25bc5205-c0a0-4d79-9db1-70415cc6082d-kube-api-access-df9hc\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:35:40.113973 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.113943 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52"] Jun 02 15:35:40.116708 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:35:40.116683 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be24646_a1ac_4a0a_906f_8be44cb6ba31.slice/crio-413f8a629727a1417ae2e955ca98f79e00ea650a148eecb542bca88b3c1c2eac WatchSource:0}: Error finding container 413f8a629727a1417ae2e955ca98f79e00ea650a148eecb542bca88b3c1c2eac: Status 404 returned error can't find the container with id 413f8a629727a1417ae2e955ca98f79e00ea650a148eecb542bca88b3c1c2eac Jun 02 15:35:40.132745 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.132716 2567 status_manager.go:895] "Failed to get status for pod" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-bbfhh" err="pods \"limitador-operator-controller-manager-85c4996f8c-bbfhh\" is forbidden: User \"system:node:ip-10-0-136-206.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-206.ec2.internal' and this object" Jun 02 15:35:40.620341 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.620307 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25bc5205-c0a0-4d79-9db1-70415cc6082d" path="/var/lib/kubelet/pods/25bc5205-c0a0-4d79-9db1-70415cc6082d/volumes" Jun 02 15:35:40.826889 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.826859 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" event={"ID":"5be24646-a1ac-4a0a-906f-8be44cb6ba31","Type":"ContainerStarted","Data":"891ec10dc108f72b062d91b9268c875098622c343077af16fb848e6d9e27e091"} Jun 02 15:35:40.826889 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.826894 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" event={"ID":"5be24646-a1ac-4a0a-906f-8be44cb6ba31","Type":"ContainerStarted","Data":"413f8a629727a1417ae2e955ca98f79e00ea650a148eecb542bca88b3c1c2eac"} Jun 02 15:35:40.827273 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.827011 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:35:40.847856 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:40.847810 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" podStartSLOduration=1.847797028 podStartE2EDuration="1.847797028s" podCreationTimestamp="2026-06-02 15:35:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:35:40.845289341 +0000 UTC m=+716.701209291" watchObservedRunningTime="2026-06-02 15:35:40.847797028 +0000 UTC m=+716.703717040" Jun 02 15:35:51.832074 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:35:51.832035 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wsm52" Jun 02 15:36:31.032879 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.032842 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:31.036639 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.036617 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.039882 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.039861 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhqjm\"" Jun 02 15:36:31.040655 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.040637 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 15:36:31.064808 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.064783 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:31.129268 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.129233 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:31.133480 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.133455 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/709a446c-c362-44e7-9f6c-1ea8b13c5e62-config-file\") pod \"limitador-limitador-7d549b5b-btg6c\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.133607 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.133501 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtts\" (UniqueName: \"kubernetes.io/projected/709a446c-c362-44e7-9f6c-1ea8b13c5e62-kube-api-access-cjtts\") pod \"limitador-limitador-7d549b5b-btg6c\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.234700 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.234665 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/709a446c-c362-44e7-9f6c-1ea8b13c5e62-config-file\") pod \"limitador-limitador-7d549b5b-btg6c\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.234834 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.234746 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtts\" (UniqueName: \"kubernetes.io/projected/709a446c-c362-44e7-9f6c-1ea8b13c5e62-kube-api-access-cjtts\") pod \"limitador-limitador-7d549b5b-btg6c\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.235282 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.235263 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/709a446c-c362-44e7-9f6c-1ea8b13c5e62-config-file\") pod \"limitador-limitador-7d549b5b-btg6c\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.247919 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.247894 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtts\" (UniqueName: \"kubernetes.io/projected/709a446c-c362-44e7-9f6c-1ea8b13c5e62-kube-api-access-cjtts\") pod \"limitador-limitador-7d549b5b-btg6c\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.347036 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.346973 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:31.498581 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:31.498558 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:31.500536 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:36:31.500510 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709a446c_c362_44e7_9f6c_1ea8b13c5e62.slice/crio-25d2bb740fcb168261701792d2e4aa937d88746f33c6b790561b683ddda518d3 WatchSource:0}: Error finding container 25d2bb740fcb168261701792d2e4aa937d88746f33c6b790561b683ddda518d3: Status 404 returned error can't find the container with id 25d2bb740fcb168261701792d2e4aa937d88746f33c6b790561b683ddda518d3 Jun 02 15:36:32.010431 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:32.010382 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" event={"ID":"709a446c-c362-44e7-9f6c-1ea8b13c5e62","Type":"ContainerStarted","Data":"25d2bb740fcb168261701792d2e4aa937d88746f33c6b790561b683ddda518d3"} Jun 02 15:36:35.023086 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:35.023046 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" event={"ID":"709a446c-c362-44e7-9f6c-1ea8b13c5e62","Type":"ContainerStarted","Data":"35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c"} Jun 02 15:36:35.023618 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:35.023179 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:35.047085 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:35.047037 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" podStartSLOduration=2.435707998 podStartE2EDuration="5.047021926s" podCreationTimestamp="2026-06-02 15:36:30 +0000 UTC" firstStartedPulling="2026-06-02 15:36:31.502346291 +0000 UTC m=+767.358266227" lastFinishedPulling="2026-06-02 15:36:34.113660218 +0000 UTC m=+769.969580155" observedRunningTime="2026-06-02 15:36:35.044496499 +0000 UTC m=+770.900416446" watchObservedRunningTime="2026-06-02 15:36:35.047021926 +0000 UTC m=+770.902941871" Jun 02 15:36:46.027799 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:46.027768 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:48.811761 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:48.811729 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:48.812157 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:48.811931 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" podUID="709a446c-c362-44e7-9f6c-1ea8b13c5e62" containerName="limitador" containerID="cri-o://35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c" gracePeriod=30 Jun 02 15:36:49.366619 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.366590 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:49.497269 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.497243 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/709a446c-c362-44e7-9f6c-1ea8b13c5e62-config-file\") pod \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " Jun 02 15:36:49.497435 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.497313 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjtts\" (UniqueName: \"kubernetes.io/projected/709a446c-c362-44e7-9f6c-1ea8b13c5e62-kube-api-access-cjtts\") pod \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\" (UID: \"709a446c-c362-44e7-9f6c-1ea8b13c5e62\") " Jun 02 15:36:49.497667 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.497645 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/709a446c-c362-44e7-9f6c-1ea8b13c5e62-config-file" (OuterVolumeSpecName: "config-file") pod "709a446c-c362-44e7-9f6c-1ea8b13c5e62" (UID: "709a446c-c362-44e7-9f6c-1ea8b13c5e62"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 15:36:49.500110 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.500084 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/709a446c-c362-44e7-9f6c-1ea8b13c5e62-kube-api-access-cjtts" (OuterVolumeSpecName: "kube-api-access-cjtts") pod "709a446c-c362-44e7-9f6c-1ea8b13c5e62" (UID: "709a446c-c362-44e7-9f6c-1ea8b13c5e62"). InnerVolumeSpecName "kube-api-access-cjtts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:36:49.598833 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.598797 2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/709a446c-c362-44e7-9f6c-1ea8b13c5e62-config-file\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:36:49.598833 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:49.598835 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjtts\" (UniqueName: \"kubernetes.io/projected/709a446c-c362-44e7-9f6c-1ea8b13c5e62-kube-api-access-cjtts\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:36:50.073691 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.073650 2567 generic.go:358] "Generic (PLEG): container finished" podID="709a446c-c362-44e7-9f6c-1ea8b13c5e62" containerID="35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c" exitCode=0 Jun 02 15:36:50.074167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.073736 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" Jun 02 15:36:50.074167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.073735 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" event={"ID":"709a446c-c362-44e7-9f6c-1ea8b13c5e62","Type":"ContainerDied","Data":"35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c"} Jun 02 15:36:50.074167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.073784 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-btg6c" event={"ID":"709a446c-c362-44e7-9f6c-1ea8b13c5e62","Type":"ContainerDied","Data":"25d2bb740fcb168261701792d2e4aa937d88746f33c6b790561b683ddda518d3"} Jun 02 15:36:50.074167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.073803 2567 scope.go:117] "RemoveContainer" containerID="35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c" Jun 02 15:36:50.082353 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.082332 2567 scope.go:117] "RemoveContainer" containerID="35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c" Jun 02 15:36:50.082636 ip-10-0-136-206 kubenswrapper[2567]: E0602 15:36:50.082616 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c\": container with ID starting with 35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c not found: ID does not exist" containerID="35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c" Jun 02 15:36:50.082700 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.082649 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c"} err="failed to get container status \"35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c\": rpc error: code = NotFound desc = could not find container \"35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c\": container with ID starting with 35bcad0e8c04df0328a15631387e728824dd2504ffb371b26f3327d6f502a78c not found: ID does not exist" Jun 02 15:36:50.106585 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.106563 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:50.114167 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.114146 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-btg6c"] Jun 02 15:36:50.620454 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:50.620397 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="709a446c-c362-44e7-9f6c-1ea8b13c5e62" path="/var/lib/kubelet/pods/709a446c-c362-44e7-9f6c-1ea8b13c5e62/volumes" Jun 02 15:36:51.642737 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.642662 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5mlcb"] Jun 02 15:36:51.643260 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.643060 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="709a446c-c362-44e7-9f6c-1ea8b13c5e62" containerName="limitador" Jun 02 15:36:51.643260 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.643070 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="709a446c-c362-44e7-9f6c-1ea8b13c5e62" containerName="limitador" Jun 02 15:36:51.643260 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.643131 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="709a446c-c362-44e7-9f6c-1ea8b13c5e62" containerName="limitador" Jun 02 15:36:51.647307 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.647285 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.653070 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.653052 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 15:36:51.669315 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.669288 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5mlcb"] Jun 02 15:36:51.820358 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.820318 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vc4\" (UniqueName: \"kubernetes.io/projected/cb33c36a-1680-4f45-8ba6-c547520c1bc4-kube-api-access-d4vc4\") pod \"postgres-68c4fbbd6f-5mlcb\" (UID: \"cb33c36a-1680-4f45-8ba6-c547520c1bc4\") " pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.820542 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.820469 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb33c36a-1680-4f45-8ba6-c547520c1bc4-data\") pod \"postgres-68c4fbbd6f-5mlcb\" (UID: \"cb33c36a-1680-4f45-8ba6-c547520c1bc4\") " pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.921516 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.921404 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vc4\" (UniqueName: \"kubernetes.io/projected/cb33c36a-1680-4f45-8ba6-c547520c1bc4-kube-api-access-d4vc4\") pod \"postgres-68c4fbbd6f-5mlcb\" (UID: \"cb33c36a-1680-4f45-8ba6-c547520c1bc4\") " pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.921656 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.921560 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb33c36a-1680-4f45-8ba6-c547520c1bc4-data\") pod \"postgres-68c4fbbd6f-5mlcb\" (UID: \"cb33c36a-1680-4f45-8ba6-c547520c1bc4\") " pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.921953 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.921933 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cb33c36a-1680-4f45-8ba6-c547520c1bc4-data\") pod \"postgres-68c4fbbd6f-5mlcb\" (UID: \"cb33c36a-1680-4f45-8ba6-c547520c1bc4\") " pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.936553 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.936528 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vc4\" (UniqueName: \"kubernetes.io/projected/cb33c36a-1680-4f45-8ba6-c547520c1bc4-kube-api-access-d4vc4\") pod \"postgres-68c4fbbd6f-5mlcb\" (UID: \"cb33c36a-1680-4f45-8ba6-c547520c1bc4\") " pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:51.962382 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:51.962355 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:52.124937 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:52.124904 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-5mlcb"] Jun 02 15:36:52.131680 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:36:52.131650 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb33c36a_1680_4f45_8ba6_c547520c1bc4.slice/crio-44d5b2654861e1b35cda699f6ed0d6dd669a1fa62dfc0ea791c0a105c0eb6fc4 WatchSource:0}: Error finding container 44d5b2654861e1b35cda699f6ed0d6dd669a1fa62dfc0ea791c0a105c0eb6fc4: Status 404 returned error can't find the container with id 44d5b2654861e1b35cda699f6ed0d6dd669a1fa62dfc0ea791c0a105c0eb6fc4 Jun 02 15:36:53.086952 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:53.086906 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" event={"ID":"cb33c36a-1680-4f45-8ba6-c547520c1bc4","Type":"ContainerStarted","Data":"44d5b2654861e1b35cda699f6ed0d6dd669a1fa62dfc0ea791c0a105c0eb6fc4"} Jun 02 15:36:55.094825 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:55.094787 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" event={"ID":"cb33c36a-1680-4f45-8ba6-c547520c1bc4","Type":"ContainerStarted","Data":"9fbe8dde1f41ff5e7fe0fffbff715ce206df8a575736f77bf9cd5bd3f58b8773"} Jun 02 15:36:55.095204 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:55.094898 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:36:55.117643 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:36:55.117602 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" podStartSLOduration=2.175253961 podStartE2EDuration="4.117589537s" podCreationTimestamp="2026-06-02 15:36:51 +0000 UTC" firstStartedPulling="2026-06-02 15:36:52.133246783 +0000 UTC m=+787.989166709" lastFinishedPulling="2026-06-02 15:36:54.075582359 +0000 UTC m=+789.931502285" observedRunningTime="2026-06-02 15:36:55.116138916 +0000 UTC m=+790.972058863" watchObservedRunningTime="2026-06-02 15:36:55.117589537 +0000 UTC m=+790.973509482" Jun 02 15:37:01.130584 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:01.130556 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-5mlcb" Jun 02 15:37:13.195228 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.195196 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-gs8lp"] Jun 02 15:37:13.205130 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.205111 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" Jun 02 15:37:13.209655 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.209636 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 15:37:13.210111 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.210097 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 15:37:13.210173 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.210103 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-nshbm\"" Jun 02 15:37:13.231507 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.231477 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-gs8lp"] Jun 02 15:37:13.320588 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.320554 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqqtm\" (UniqueName: \"kubernetes.io/projected/2845795c-8f0a-4d90-90e5-599264fc7a16-kube-api-access-vqqtm\") pod \"keycloak-operator-7864d68cbd-gs8lp\" (UID: \"2845795c-8f0a-4d90-90e5-599264fc7a16\") " pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" Jun 02 15:37:13.421030 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.420989 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqqtm\" (UniqueName: \"kubernetes.io/projected/2845795c-8f0a-4d90-90e5-599264fc7a16-kube-api-access-vqqtm\") pod \"keycloak-operator-7864d68cbd-gs8lp\" (UID: \"2845795c-8f0a-4d90-90e5-599264fc7a16\") " pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" Jun 02 15:37:13.432837 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.432810 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqqtm\" (UniqueName: \"kubernetes.io/projected/2845795c-8f0a-4d90-90e5-599264fc7a16-kube-api-access-vqqtm\") pod \"keycloak-operator-7864d68cbd-gs8lp\" (UID: \"2845795c-8f0a-4d90-90e5-599264fc7a16\") " pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" Jun 02 15:37:13.515912 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.515885 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" Jun 02 15:37:13.684132 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:13.684020 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-gs8lp"] Jun 02 15:37:13.686599 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:37:13.686548 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2845795c_8f0a_4d90_90e5_599264fc7a16.slice/crio-0a2b93cfe5d07e765ed8bb10ea873a9301e5354d79c603ecb3d07b345814c8f1 WatchSource:0}: Error finding container 0a2b93cfe5d07e765ed8bb10ea873a9301e5354d79c603ecb3d07b345814c8f1: Status 404 returned error can't find the container with id 0a2b93cfe5d07e765ed8bb10ea873a9301e5354d79c603ecb3d07b345814c8f1 Jun 02 15:37:14.161404 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:14.161366 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" event={"ID":"2845795c-8f0a-4d90-90e5-599264fc7a16","Type":"ContainerStarted","Data":"0a2b93cfe5d07e765ed8bb10ea873a9301e5354d79c603ecb3d07b345814c8f1"} Jun 02 15:37:21.188236 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:21.188191 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" event={"ID":"2845795c-8f0a-4d90-90e5-599264fc7a16","Type":"ContainerStarted","Data":"0e6000661576888929cf852d37823919fbda5a53e92dc3e09b1f9643e7bd54b9"} Jun 02 15:37:21.208879 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:37:21.208830 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-gs8lp" podStartSLOduration=1.509132959 podStartE2EDuration="8.208817821s" podCreationTimestamp="2026-06-02 15:37:13 +0000 UTC" firstStartedPulling="2026-06-02 15:37:13.687914963 +0000 UTC m=+809.543834886" lastFinishedPulling="2026-06-02 15:37:20.387599813 +0000 UTC m=+816.243519748" observedRunningTime="2026-06-02 15:37:21.206501687 +0000 UTC m=+817.062421634" watchObservedRunningTime="2026-06-02 15:37:21.208817821 +0000 UTC m=+817.064737831" Jun 02 15:38:39.208468 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.208428 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vxpwb"] Jun 02 15:38:39.212314 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.212290 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:38:39.215000 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.214881 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 15:38:39.215000 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.214960 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jddbz\"" Jun 02 15:38:39.225228 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.225208 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vxpwb"] Jun 02 15:38:39.284549 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.284516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6hxp\" (UniqueName: \"kubernetes.io/projected/26299bd8-1d48-4ce3-9eb1-2b333ecff6f3-kube-api-access-m6hxp\") pod \"payload-processing-58b6c8fdc7-vxpwb\" (UID: \"26299bd8-1d48-4ce3-9eb1-2b333ecff6f3\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:38:39.385175 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.385141 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m6hxp\" (UniqueName: \"kubernetes.io/projected/26299bd8-1d48-4ce3-9eb1-2b333ecff6f3-kube-api-access-m6hxp\") pod \"payload-processing-58b6c8fdc7-vxpwb\" (UID: \"26299bd8-1d48-4ce3-9eb1-2b333ecff6f3\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:38:39.402382 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.402346 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6hxp\" (UniqueName: \"kubernetes.io/projected/26299bd8-1d48-4ce3-9eb1-2b333ecff6f3-kube-api-access-m6hxp\") pod \"payload-processing-58b6c8fdc7-vxpwb\" (UID: \"26299bd8-1d48-4ce3-9eb1-2b333ecff6f3\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:38:39.523560 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.523533 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:38:39.675972 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.675938 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vxpwb"] Jun 02 15:38:39.677558 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:38:39.677533 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26299bd8_1d48_4ce3_9eb1_2b333ecff6f3.slice/crio-26435a3390858c6ebfcfef3f3f92601ec2b70a3f35923361874029c00d83f930 WatchSource:0}: Error finding container 26435a3390858c6ebfcfef3f3f92601ec2b70a3f35923361874029c00d83f930: Status 404 returned error can't find the container with id 26435a3390858c6ebfcfef3f3f92601ec2b70a3f35923361874029c00d83f930 Jun 02 15:38:39.679606 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:39.679584 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:38:40.472912 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:40.472861 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" event={"ID":"26299bd8-1d48-4ce3-9eb1-2b333ecff6f3","Type":"ContainerStarted","Data":"26435a3390858c6ebfcfef3f3f92601ec2b70a3f35923361874029c00d83f930"} Jun 02 15:38:42.485058 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:42.485024 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" event={"ID":"26299bd8-1d48-4ce3-9eb1-2b333ecff6f3","Type":"ContainerStarted","Data":"0ea5a5be2ea97d2ba666e44039f4e8ff07a8043618ca2c42ba322af3a85ce2eb"} Jun 02 15:38:42.485465 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:42.485131 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:38:42.504452 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:42.504387 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" podStartSLOduration=1.230411752 podStartE2EDuration="3.504374367s" podCreationTimestamp="2026-06-02 15:38:39 +0000 UTC" firstStartedPulling="2026-06-02 15:38:39.679709204 +0000 UTC m=+895.535629127" lastFinishedPulling="2026-06-02 15:38:41.953671816 +0000 UTC m=+897.809591742" observedRunningTime="2026-06-02 15:38:42.502827929 +0000 UTC m=+898.358747874" watchObservedRunningTime="2026-06-02 15:38:42.504374367 +0000 UTC m=+898.360294312" Jun 02 15:38:53.491570 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:38:53.491537 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-vxpwb" Jun 02 15:39:57.008924 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.008844 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8"] Jun 02 15:39:57.013647 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.013607 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.017256 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.017173 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 15:39:57.017546 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.017469 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-px7g7\"" Jun 02 15:39:57.017685 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.017607 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 15:39:57.017685 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.017673 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 15:39:57.025042 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.025016 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8"] Jun 02 15:39:57.085312 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.085267 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.085312 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.085310 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b49a273-9cb8-4b65-8880-d1550ff16405-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.085534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.085340 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6pbj\" (UniqueName: \"kubernetes.io/projected/3b49a273-9cb8-4b65-8880-d1550ff16405-kube-api-access-z6pbj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.085534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.085407 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.085534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.085488 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.085534 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.085516 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186129 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186099 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186135 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186164 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186184 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b49a273-9cb8-4b65-8880-d1550ff16405-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186222 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6pbj\" (UniqueName: \"kubernetes.io/projected/3b49a273-9cb8-4b65-8880-d1550ff16405-kube-api-access-z6pbj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186294 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186280 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186586 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186519 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186586 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186539 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.186709 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.186693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.188631 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.188611 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b49a273-9cb8-4b65-8880-d1550ff16405-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.188720 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.188684 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b49a273-9cb8-4b65-8880-d1550ff16405-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.194702 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.194681 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6pbj\" (UniqueName: \"kubernetes.io/projected/3b49a273-9cb8-4b65-8880-d1550ff16405-kube-api-access-z6pbj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8\" (UID: \"3b49a273-9cb8-4b65-8880-d1550ff16405\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.328580 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.328502 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:39:57.465475 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.465453 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8"] Jun 02 15:39:57.467734 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:39:57.467708 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b49a273_9cb8_4b65_8880_d1550ff16405.slice/crio-a4913032c28b72b63ff9ae93ac8c2f340cfa11649fd87862c2c879750bf31fd1 WatchSource:0}: Error finding container a4913032c28b72b63ff9ae93ac8c2f340cfa11649fd87862c2c879750bf31fd1: Status 404 returned error can't find the container with id a4913032c28b72b63ff9ae93ac8c2f340cfa11649fd87862c2c879750bf31fd1 Jun 02 15:39:57.758770 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:39:57.758730 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" event={"ID":"3b49a273-9cb8-4b65-8880-d1550ff16405","Type":"ContainerStarted","Data":"a4913032c28b72b63ff9ae93ac8c2f340cfa11649fd87862c2c879750bf31fd1"} Jun 02 15:40:00.773724 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:00.773639 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" event={"ID":"3b49a273-9cb8-4b65-8880-d1550ff16405","Type":"ContainerStarted","Data":"301737d6c7df4ab36b8778bb0b1e41e49c6eebae41306a80a2ac4e72e4ed7acb"} Jun 02 15:40:02.783349 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:02.783308 2567 generic.go:358] "Generic (PLEG): container finished" podID="3b49a273-9cb8-4b65-8880-d1550ff16405" containerID="301737d6c7df4ab36b8778bb0b1e41e49c6eebae41306a80a2ac4e72e4ed7acb" exitCode=0 Jun 02 15:40:02.783349 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:02.783350 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" event={"ID":"3b49a273-9cb8-4b65-8880-d1550ff16405","Type":"ContainerDied","Data":"301737d6c7df4ab36b8778bb0b1e41e49c6eebae41306a80a2ac4e72e4ed7acb"} Jun 02 15:40:09.810403 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:09.810369 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" event={"ID":"3b49a273-9cb8-4b65-8880-d1550ff16405","Type":"ContainerStarted","Data":"faaa3ab22b334e195f633e36efe3e8e3bc2cdd3322bda4e513daf4b32d63e01b"} Jun 02 15:40:09.842977 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:09.842934 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" podStartSLOduration=2.414176353 podStartE2EDuration="13.842920136s" podCreationTimestamp="2026-06-02 15:39:56 +0000 UTC" firstStartedPulling="2026-06-02 15:39:57.469920833 +0000 UTC m=+973.325840759" lastFinishedPulling="2026-06-02 15:40:08.898664606 +0000 UTC m=+984.754584542" observedRunningTime="2026-06-02 15:40:09.842889334 +0000 UTC m=+985.698809304" watchObservedRunningTime="2026-06-02 15:40:09.842920136 +0000 UTC m=+985.698840127" Jun 02 15:40:17.329216 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:17.329180 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:40:17.329751 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:17.329252 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:40:17.341753 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:17.341729 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:40:17.849350 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:40:17.849321 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8" Jun 02 15:45:00.152496 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.152460 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29673585-cxnqh"] Jun 02 15:45:00.157092 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.157066 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:45:00.160155 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.160136 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-fphdx\"" Jun 02 15:45:00.177043 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.177013 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673585-cxnqh"] Jun 02 15:45:00.249619 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.249591 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhrbb\" (UniqueName: \"kubernetes.io/projected/fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc-kube-api-access-nhrbb\") pod \"maas-api-key-cleanup-29673585-cxnqh\" (UID: \"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc\") " pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:45:00.350332 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.350299 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhrbb\" (UniqueName: \"kubernetes.io/projected/fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc-kube-api-access-nhrbb\") pod \"maas-api-key-cleanup-29673585-cxnqh\" (UID: \"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc\") " pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:45:00.359515 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.359486 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhrbb\" (UniqueName: \"kubernetes.io/projected/fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc-kube-api-access-nhrbb\") pod \"maas-api-key-cleanup-29673585-cxnqh\" (UID: \"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc\") " pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:45:00.469182 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.469106 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:45:00.595745 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.595720 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29673585-cxnqh"] Jun 02 15:45:00.598097 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:45:00.598066 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd13b8a2_b4b7_40f4_a682_f48b51c2a9cc.slice/crio-e0e0f9cc6d8531fbae049391aa54a0b24eb53b9467a86400d9d0de19615c3453 WatchSource:0}: Error finding container e0e0f9cc6d8531fbae049391aa54a0b24eb53b9467a86400d9d0de19615c3453: Status 404 returned error can't find the container with id e0e0f9cc6d8531fbae049391aa54a0b24eb53b9467a86400d9d0de19615c3453 Jun 02 15:45:00.599877 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.599862 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 15:45:00.826948 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:00.826916 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" event={"ID":"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc","Type":"ContainerStarted","Data":"e0e0f9cc6d8531fbae049391aa54a0b24eb53b9467a86400d9d0de19615c3453"} Jun 02 15:45:03.841485 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:03.841453 2567 generic.go:358] "Generic (PLEG): container finished" podID="fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc" containerID="5fe285a5d37ca79975c7c3ed3184befb9c11585a4a9bf839d31e6c57c47562d1" exitCode=0 Jun 02 15:45:03.841828 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:03.841538 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" event={"ID":"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc","Type":"ContainerDied","Data":"5fe285a5d37ca79975c7c3ed3184befb9c11585a4a9bf839d31e6c57c47562d1"} Jun 02 15:45:04.981658 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:04.981637 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:45:05.097279 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:05.097214 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhrbb\" (UniqueName: \"kubernetes.io/projected/fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc-kube-api-access-nhrbb\") pod \"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc\" (UID: \"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc\") " Jun 02 15:45:05.099449 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:05.099424 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc-kube-api-access-nhrbb" (OuterVolumeSpecName: "kube-api-access-nhrbb") pod "fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc" (UID: "fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc"). InnerVolumeSpecName "kube-api-access-nhrbb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 15:45:05.198085 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:05.198057 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhrbb\" (UniqueName: \"kubernetes.io/projected/fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc-kube-api-access-nhrbb\") on node \"ip-10-0-136-206.ec2.internal\" DevicePath \"\"" Jun 02 15:45:05.849737 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:05.849699 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" event={"ID":"fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc","Type":"ContainerDied","Data":"e0e0f9cc6d8531fbae049391aa54a0b24eb53b9467a86400d9d0de19615c3453"} Jun 02 15:45:05.849895 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:05.849744 2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0e0f9cc6d8531fbae049391aa54a0b24eb53b9467a86400d9d0de19615c3453" Jun 02 15:45:05.849895 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:45:05.849720 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29673585-cxnqh" Jun 02 15:46:37.291349 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:37.291317 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-756bd9f55b-6nrpx_3d064a13-c126-42c8-9d15-0cb6f6cd4670/nginx/0.log" Jun 02 15:46:37.535293 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:37.535234 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-9xl8t_29676aba-c502-4031-bd88-9f659da307d0/manager/0.log" Jun 02 15:46:37.664103 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:37.664029 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-v468f_1b945f2b-8b68-495d-9cd8-281904c25ad3/manager/0.log" Jun 02 15:46:37.902122 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:37.902094 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673585-cxnqh_fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc/cleanup/0.log" Jun 02 15:46:38.139059 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:38.139026 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-584cx_293789e3-05bf-47bc-94e8-20a51d4a51e7/server/0.log" Jun 02 15:46:38.270820 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:38.270794 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-8nths_b6c47765-bd4b-46a6-8252-05ff04eaa548/manager/0.log" Jun 02 15:46:38.400359 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:38.400290 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x_ada03064-93bf-47b0-87c5-1835e91b88bd/copy-manifests/0.log" Jun 02 15:46:38.408142 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:38.408118 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x_ada03064-93bf-47b0-87c5-1835e91b88bd/manager/0.log" Jun 02 15:46:38.819265 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:38.819234 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5mlcb_cb33c36a-1680-4f45-8ba6-c547520c1bc4/postgres/0.log" Jun 02 15:46:41.122307 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:41.122268 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-wsm52_5be24646-a1ac-4a0a-906f-8be44cb6ba31/manager/0.log" Jun 02 15:46:41.639135 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:41.639108 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-lb7sw_edba82d0-4b5b-4575-a078-352f9b01c22a/discovery/0.log" Jun 02 15:46:41.765536 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:41.765500 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bcfb9d8b-4z845_6dccf40a-c0d0-4a1d-a955-df78de403947/kube-auth-proxy/0.log" Jun 02 15:46:42.113782 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:42.113742 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-vxpwb_26299bd8-1d48-4ce3-9eb1-2b333ecff6f3/payload-processing/0.log" Jun 02 15:46:42.231508 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:42.231483 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f6b7fc679-7x44m_28929637-9b6e-436a-8eea-7d4cce493b5b/router/0.log" Jun 02 15:46:42.876715 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:42.876683 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8_3b49a273-9cb8-4b65-8880-d1550ff16405/storage-initializer/0.log" Jun 02 15:46:42.885003 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:42.884974 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-htgt8_3b49a273-9cb8-4b65-8880-d1550ff16405/main/0.log" Jun 02 15:46:50.186970 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:50.186941 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v4cd6_d9ca7d05-8461-4cdf-b3a1-801e9041c6a3/global-pull-secret-syncer/0.log" Jun 02 15:46:50.282305 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:50.282271 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-grt4p_76a4adf4-a9b4-43fc-b264-7c089c010e79/konnectivity-agent/0.log" Jun 02 15:46:50.343075 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:50.343052 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-206.ec2.internal_dafe25634ae07728f9205f8aca9d250b/haproxy/0.log" Jun 02 15:46:54.873007 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:54.872919 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-wsm52_5be24646-a1ac-4a0a-906f-8be44cb6ba31/manager/0.log" Jun 02 15:46:56.563760 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:56.563727 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-fjm8h_4a2e454c-1d56-423a-a325-6f02ce1c9e85/cluster-monitoring-operator/0.log" Jun 02 15:46:56.676118 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:56.676094 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f54f9b78b-hw7sr_534f8ba2-a870-477b-b479-02cec1c972b4/metrics-server/0.log" Jun 02 15:46:56.703269 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:56.703248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-dkqgv_b49cb86a-0db8-487e-934f-6dd918c92255/monitoring-plugin/0.log" Jun 02 15:46:56.825067 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:56.824991 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr2lk_b70049eb-2158-4d0b-8ea2-b45dca08fda0/node-exporter/0.log" Jun 02 15:46:56.845148 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:56.845125 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr2lk_b70049eb-2158-4d0b-8ea2-b45dca08fda0/kube-rbac-proxy/0.log" Jun 02 15:46:56.871333 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:56.871312 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mr2lk_b70049eb-2158-4d0b-8ea2-b45dca08fda0/init-textfile/0.log" Jun 02 15:46:57.117295 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.117213 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/prometheus/0.log" Jun 02 15:46:57.137430 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.137393 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/config-reloader/0.log" Jun 02 15:46:57.164562 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.164540 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/thanos-sidecar/0.log" Jun 02 15:46:57.185881 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.185863 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/kube-rbac-proxy-web/0.log" Jun 02 15:46:57.209292 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.209271 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/kube-rbac-proxy/0.log" Jun 02 15:46:57.232259 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.232237 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/kube-rbac-proxy-thanos/0.log" Jun 02 15:46:57.261749 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.261727 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e96dcb6-6272-4177-a479-1cfb90717698/init-config-reloader/0.log" Jun 02 15:46:57.292746 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.292726 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-v2pjx_f3b7412b-d8a6-4397-ad3c-948f73d2fcb0/prometheus-operator/0.log" Jun 02 15:46:57.313006 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.312988 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-v2pjx_f3b7412b-d8a6-4397-ad3c-948f73d2fcb0/kube-rbac-proxy/0.log" Jun 02 15:46:57.452798 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.452730 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4ddb4587-f6bgg_3c28d833-f0ad-471e-b930-892a4ea3cfd6/thanos-query/0.log" Jun 02 15:46:57.478523 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.478499 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4ddb4587-f6bgg_3c28d833-f0ad-471e-b930-892a4ea3cfd6/kube-rbac-proxy-web/0.log" Jun 02 15:46:57.502126 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.502102 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4ddb4587-f6bgg_3c28d833-f0ad-471e-b930-892a4ea3cfd6/kube-rbac-proxy/0.log" Jun 02 15:46:57.525723 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.525702 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4ddb4587-f6bgg_3c28d833-f0ad-471e-b930-892a4ea3cfd6/prom-label-proxy/0.log" Jun 02 15:46:57.547085 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.547066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4ddb4587-f6bgg_3c28d833-f0ad-471e-b930-892a4ea3cfd6/kube-rbac-proxy-rules/0.log" Jun 02 15:46:57.567569 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:57.567548 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f4ddb4587-f6bgg_3c28d833-f0ad-471e-b930-892a4ea3cfd6/kube-rbac-proxy-metrics/0.log" Jun 02 15:46:58.665598 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.665559 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8"] Jun 02 15:46:58.666109 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.666092 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc" containerName="cleanup" Jun 02 15:46:58.666168 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.666112 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc" containerName="cleanup" Jun 02 15:46:58.666206 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.666174 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc" containerName="cleanup" Jun 02 15:46:58.669099 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.669084 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.674152 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.674129 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzc9k\"/\"kube-root-ca.crt\"" Jun 02 15:46:58.674943 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.674860 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nzc9k\"/\"default-dockercfg-7sr8k\"" Jun 02 15:46:58.674943 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.674898 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nzc9k\"/\"openshift-service-ca.crt\"" Jun 02 15:46:58.684039 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.684016 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8"] Jun 02 15:46:58.797589 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.797555 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-sys\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.797790 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.797613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-podres\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.797790 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.797739 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-lib-modules\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.797902 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.797789 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-proc\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.797902 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.797861 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8l55\" (UniqueName: \"kubernetes.io/projected/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-kube-api-access-z8l55\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899229 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899189 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8l55\" (UniqueName: \"kubernetes.io/projected/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-kube-api-access-z8l55\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899400 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-sys\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899400 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899313 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-podres\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899400 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-sys\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899611 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899389 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-lib-modules\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899611 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899470 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-proc\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899611 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899516 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-lib-modules\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899611 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-podres\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.899611 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.899567 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-proc\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.909166 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.909143 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8l55\" (UniqueName: \"kubernetes.io/projected/d877a4cb-a37b-46cc-9c1e-162ff4906dc4-kube-api-access-z8l55\") pod \"perf-node-gather-daemonset-q9nk8\" (UID: \"d877a4cb-a37b-46cc-9c1e-162ff4906dc4\") " pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:58.979016 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:58.978951 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:59.114268 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:59.114242 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8"] Jun 02 15:46:59.116771 ip-10-0-136-206 kubenswrapper[2567]: W0602 15:46:59.116743 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd877a4cb_a37b_46cc_9c1e_162ff4906dc4.slice/crio-978f6057cb4f1379bdc42deb385415d7257e3ca1d3dbcce62b3362b6601b9a42 WatchSource:0}: Error finding container 978f6057cb4f1379bdc42deb385415d7257e3ca1d3dbcce62b3362b6601b9a42: Status 404 returned error can't find the container with id 978f6057cb4f1379bdc42deb385415d7257e3ca1d3dbcce62b3362b6601b9a42 Jun 02 15:46:59.263199 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:59.263168 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" event={"ID":"d877a4cb-a37b-46cc-9c1e-162ff4906dc4","Type":"ContainerStarted","Data":"f9e0e20aaa93c441a26486ab0c05da15de131f5e26d2e2232339aaeda79582fa"} Jun 02 15:46:59.263310 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:59.263207 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" event={"ID":"d877a4cb-a37b-46cc-9c1e-162ff4906dc4","Type":"ContainerStarted","Data":"978f6057cb4f1379bdc42deb385415d7257e3ca1d3dbcce62b3362b6601b9a42"} Jun 02 15:46:59.263365 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:59.263300 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:46:59.282454 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:46:59.282393 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" podStartSLOduration=1.2823813450000001 podStartE2EDuration="1.282381345s" podCreationTimestamp="2026-06-02 15:46:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 15:46:59.280878794 +0000 UTC m=+1395.136798739" watchObservedRunningTime="2026-06-02 15:46:59.282381345 +0000 UTC m=+1395.138301289" Jun 02 15:47:01.335851 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:01.335815 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gzlx7_79d97372-9182-4b0d-9250-2d2cd6383c4f/dns/0.log" Jun 02 15:47:01.361588 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:01.361560 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gzlx7_79d97372-9182-4b0d-9250-2d2cd6383c4f/kube-rbac-proxy/0.log" Jun 02 15:47:01.503088 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:01.503056 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2h25t_17ace113-3104-4a14-a812-3ec1dcd632e4/dns-node-resolver/0.log" Jun 02 15:47:02.024103 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:02.024067 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58d65f9c5-wbbxf_53bca1db-58c0-4042-9c55-2c064a86b970/registry/0.log" Jun 02 15:47:02.106505 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:02.106481 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xch9g_2b180344-0602-431e-b552-8e7144e52fd9/node-ca/0.log" Jun 02 15:47:03.103956 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:03.103930 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-lb7sw_edba82d0-4b5b-4575-a078-352f9b01c22a/discovery/0.log" Jun 02 15:47:03.126230 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:03.126198 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66bcfb9d8b-4z845_6dccf40a-c0d0-4a1d-a955-df78de403947/kube-auth-proxy/0.log" Jun 02 15:47:03.210658 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:03.210634 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-vxpwb_26299bd8-1d48-4ce3-9eb1-2b333ecff6f3/payload-processing/0.log" Jun 02 15:47:03.239928 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:03.239900 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f6b7fc679-7x44m_28929637-9b6e-436a-8eea-7d4cce493b5b/router/0.log" Jun 02 15:47:03.827846 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:03.827815 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-484fv_49ac80c2-2ef3-4019-bf29-6516f3add356/serve-healthcheck-canary/0.log" Jun 02 15:47:04.472746 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:04.472716 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffdfs_91e55bb7-c15a-436a-ac84-7f34cb5e6bbf/kube-rbac-proxy/0.log" Jun 02 15:47:04.491959 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:04.491926 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffdfs_91e55bb7-c15a-436a-ac84-7f34cb5e6bbf/exporter/0.log" Jun 02 15:47:04.513285 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:04.513261 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffdfs_91e55bb7-c15a-436a-ac84-7f34cb5e6bbf/extractor/0.log" Jun 02 15:47:05.279645 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:05.279619 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nzc9k/perf-node-gather-daemonset-q9nk8" Jun 02 15:47:06.647222 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.647193 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-756bd9f55b-6nrpx_3d064a13-c126-42c8-9d15-0cb6f6cd4670/nginx/0.log" Jun 02 15:47:06.713786 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.713748 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-9xl8t_29676aba-c502-4031-bd88-9f659da307d0/manager/0.log" Jun 02 15:47:06.763533 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.763501 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-v468f_1b945f2b-8b68-495d-9cd8-281904c25ad3/manager/0.log" Jun 02 15:47:06.821551 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.821528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29673585-cxnqh_fd13b8a2-b4b7-40f4-a682-f48b51c2a9cc/cleanup/0.log" Jun 02 15:47:06.875366 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.875308 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-584cx_293789e3-05bf-47bc-94e8-20a51d4a51e7/server/0.log" Jun 02 15:47:06.944266 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.944175 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-8nths_b6c47765-bd4b-46a6-8252-05ff04eaa548/manager/0.log" Jun 02 15:47:06.971237 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.971206 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x_ada03064-93bf-47b0-87c5-1835e91b88bd/manager/0.log" Jun 02 15:47:06.990666 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:06.990644 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bcc4c4cd6-8dh2x_ada03064-93bf-47b0-87c5-1835e91b88bd/copy-manifests/0.log" Jun 02 15:47:07.156138 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:07.156110 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-5mlcb_cb33c36a-1680-4f45-8ba6-c547520c1bc4/postgres/0.log" Jun 02 15:47:14.159201 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:14.159166 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-clgzt_7d23b6c7-b5c5-479b-a27a-14fc6685b3ee/kube-storage-version-migrator-operator/1.log" Jun 02 15:47:14.161156 ip-10-0-136-206 kubenswrapper[2567]: I0602 15:47:14.161129 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-clgzt_7d23b6c7-b5c5-479b-a27a-14fc6685b3ee/kube-storage-version-migrator-operator/0.log"