Jun 06 20:19:38.805391 ip-10-0-131-27 systemd[1]: Starting Kubernetes Kubelet... Jun 06 20:19:39.203818 ip-10-0-131-27 kubenswrapper[2537]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:19:39.203818 ip-10-0-131-27 kubenswrapper[2537]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 20:19:39.203818 ip-10-0-131-27 kubenswrapper[2537]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:19:39.203818 ip-10-0-131-27 kubenswrapper[2537]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 20:19:39.203818 ip-10-0-131-27 kubenswrapper[2537]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 20:19:39.204603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.203884 2537 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 20:19:39.209570 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209541 2537 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:39.209570 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209565 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:39.209570 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209570 2537 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:39.209570 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209573 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:39.209570 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209576 2537 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:39.209570 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209580 2537 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209583 2537 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209587 2537 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209590 2537 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209593 2537 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209596 2537 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209599 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209602 2537 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209605 2537 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209612 2537 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209615 2537 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209618 2537 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209623 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209626 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209629 2537 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209632 2537 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209656 2537 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209783 2537 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209792 2537 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:39.209789 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209797 2537 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209802 2537 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209807 2537 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209811 2537 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209816 2537 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209821 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209825 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209829 2537 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209833 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209837 2537 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209841 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209846 2537 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209850 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209855 2537 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209859 2537 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209863 2537 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209867 2537 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209871 2537 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209875 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:39.210253 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209879 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209884 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209888 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209892 2537 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209897 2537 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209901 2537 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209905 2537 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209909 2537 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209913 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209918 2537 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209925 2537 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209930 2537 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209934 2537 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209938 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209942 2537 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209945 2537 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209949 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209952 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209955 2537 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209958 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:39.210710 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209961 2537 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209963 2537 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209966 2537 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209968 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209971 2537 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209974 2537 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209977 2537 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209979 2537 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209982 2537 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209984 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209987 2537 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209990 2537 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209992 2537 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209995 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.209997 2537 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210000 2537 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210006 2537 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210009 2537 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210012 2537 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:39.211219 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210016 2537 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210019 2537 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210022 2537 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210025 2537 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210027 2537 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210030 2537 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210033 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210035 2537 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210039 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210042 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210044 2537 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210047 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210050 2537 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210053 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210057 2537 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210060 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210063 2537 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210794 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210801 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210805 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:39.211676 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210808 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210812 2537 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210816 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210820 2537 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210824 2537 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210827 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210831 2537 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210834 2537 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210837 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210840 2537 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210843 2537 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210846 2537 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210849 2537 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210851 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210855 2537 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210859 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210861 2537 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210864 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210866 2537 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:39.212177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210869 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210873 2537 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210876 2537 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210879 2537 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210881 2537 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210884 2537 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210887 2537 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210889 2537 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210892 2537 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210894 2537 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210897 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210900 2537 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210902 2537 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210905 2537 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210907 2537 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210910 2537 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210913 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210915 2537 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210918 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:39.212649 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210920 2537 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210923 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210925 2537 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210928 2537 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210930 2537 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210932 2537 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210935 2537 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210938 2537 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210940 2537 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210944 2537 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210946 2537 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210949 2537 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210951 2537 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210954 2537 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210957 2537 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210960 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210963 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210965 2537 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210968 2537 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210970 2537 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:39.213129 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210973 2537 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210975 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210977 2537 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210980 2537 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210983 2537 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210986 2537 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210988 2537 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210991 2537 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210993 2537 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210996 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.210998 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211001 2537 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211003 2537 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211006 2537 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211008 2537 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211010 2537 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211013 2537 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211016 2537 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211019 2537 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211022 2537 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:39.213616 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211036 2537 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211039 2537 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211042 2537 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211045 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211047 2537 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211050 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211054 2537 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211057 2537 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211060 2537 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211062 2537 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211065 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211067 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211070 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211073 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211075 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211078 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211080 2537 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211083 2537 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211473 2537 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211479 2537 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:39.214114 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211482 2537 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211484 2537 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211487 2537 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211490 2537 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211493 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211496 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211498 2537 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211501 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211504 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211506 2537 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211509 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211512 2537 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211514 2537 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211517 2537 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211520 2537 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211522 2537 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211525 2537 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211528 2537 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211531 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211534 2537 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:39.214597 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211537 2537 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211539 2537 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211542 2537 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211544 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211547 2537 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211549 2537 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211552 2537 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211554 2537 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211557 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211559 2537 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211562 2537 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211565 2537 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211567 2537 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211569 2537 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211572 2537 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211574 2537 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211577 2537 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211579 2537 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211581 2537 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211584 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:39.215086 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211586 2537 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211589 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211591 2537 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211594 2537 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211603 2537 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211607 2537 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211610 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211613 2537 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211616 2537 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211619 2537 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211623 2537 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211626 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211628 2537 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211631 2537 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211634 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211636 2537 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211639 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211641 2537 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211644 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:39.215618 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211646 2537 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211649 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211651 2537 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211655 2537 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211659 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211662 2537 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211664 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211667 2537 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211669 2537 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211673 2537 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211677 2537 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211680 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211683 2537 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211685 2537 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211688 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211691 2537 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211693 2537 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211696 2537 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211698 2537 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:39.216080 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211701 2537 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211703 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211706 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211709 2537 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211714 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211717 2537 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211720 2537 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211722 2537 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211725 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211727 2537 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211730 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211733 2537 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211735 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211738 2537 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211741 2537 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211743 2537 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211745 2537 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211748 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.211751 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211853 2537 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211863 2537 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 20:19:39.216671 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211872 2537 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211876 2537 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211880 2537 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211884 2537 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211888 2537 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211891 2537 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211895 2537 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211897 2537 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211901 2537 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211905 2537 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211908 2537 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211911 2537 flags.go:64] FLAG: --cgroup-root="" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211914 2537 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211917 2537 flags.go:64] FLAG: --client-ca-file="" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211921 2537 flags.go:64] FLAG: --cloud-provider="external" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211928 2537 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211933 2537 flags.go:64] FLAG: --cluster-domain="" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211936 2537 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211939 2537 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211942 2537 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211945 2537 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211949 2537 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211952 2537 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 20:19:39.217206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211956 2537 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211959 2537 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211962 2537 flags.go:64] FLAG: --contention-profiling="false" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211965 2537 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211968 2537 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211971 2537 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211974 2537 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211978 2537 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211981 2537 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211984 2537 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211986 2537 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211989 2537 flags.go:64] FLAG: --enable-server="true" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211992 2537 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.211997 2537 flags.go:64] FLAG: --event-burst="100" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212000 2537 flags.go:64] FLAG: --event-qps="50" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212002 2537 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212005 2537 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212008 2537 flags.go:64] FLAG: --eviction-hard="" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212012 2537 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212015 2537 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212018 2537 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212021 2537 flags.go:64] FLAG: --eviction-soft="" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212024 2537 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212027 2537 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212032 2537 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 20:19:39.217769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212035 2537 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212038 2537 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212041 2537 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212044 2537 flags.go:64] FLAG: --feature-gates="" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212048 2537 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212051 2537 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212053 2537 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212056 2537 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212060 2537 flags.go:64] FLAG: --healthz-port="10248" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212062 2537 flags.go:64] FLAG: --help="false" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212065 2537 flags.go:64] FLAG: --hostname-override="ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212068 2537 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212071 2537 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212074 2537 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212077 2537 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212080 2537 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212083 2537 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212086 2537 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212089 2537 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212091 2537 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212095 2537 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212098 2537 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212101 2537 flags.go:64] FLAG: --kube-reserved="" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212117 2537 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 20:19:39.218480 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212121 2537 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212126 2537 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212129 2537 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212132 2537 flags.go:64] FLAG: --lock-file="" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212135 2537 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212138 2537 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212141 2537 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212148 2537 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212152 2537 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212155 2537 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212158 2537 flags.go:64] FLAG: --logging-format="text" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212161 2537 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212164 2537 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212167 2537 flags.go:64] FLAG: --manifest-url="" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212170 2537 flags.go:64] FLAG: --manifest-url-header="" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212174 2537 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212178 2537 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212182 2537 flags.go:64] FLAG: --max-pods="110" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212185 2537 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212189 2537 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212192 2537 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212194 2537 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212197 2537 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212200 2537 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212203 2537 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 20:19:39.219129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212210 2537 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212213 2537 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212216 2537 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212219 2537 flags.go:64] FLAG: --pod-cidr="" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212222 2537 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212227 2537 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212230 2537 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212233 2537 flags.go:64] FLAG: --pods-per-core="0" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212236 2537 flags.go:64] FLAG: --port="10250" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212239 2537 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212242 2537 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-064d78e50177dd9e1" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212245 2537 flags.go:64] FLAG: --qos-reserved="" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212248 2537 flags.go:64] FLAG: --read-only-port="10255" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212251 2537 flags.go:64] FLAG: --register-node="true" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212255 2537 flags.go:64] FLAG: --register-with-taints="" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212259 2537 flags.go:64] FLAG: --registry-burst="10" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212263 2537 flags.go:64] FLAG: --registry-qps="5" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212266 2537 flags.go:64] FLAG: --reserved-cpus="" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212269 2537 flags.go:64] FLAG: --reserved-memory="" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212272 2537 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212275 2537 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212278 2537 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212281 2537 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212284 2537 flags.go:64] FLAG: --runonce="false" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212287 2537 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 20:19:39.219764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212290 2537 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212293 2537 flags.go:64] FLAG: --seccomp-default="false" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212296 2537 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212298 2537 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212301 2537 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212304 2537 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212307 2537 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212310 2537 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212313 2537 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212315 2537 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212318 2537 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212321 2537 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212324 2537 flags.go:64] FLAG: --system-cgroups="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212327 2537 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212332 2537 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212335 2537 flags.go:64] FLAG: --tls-cert-file="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212337 2537 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212342 2537 flags.go:64] FLAG: --tls-min-version="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212344 2537 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212347 2537 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212350 2537 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212354 2537 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212357 2537 flags.go:64] FLAG: --v="2" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212361 2537 flags.go:64] FLAG: --version="false" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212366 2537 flags.go:64] FLAG: --vmodule="" Jun 06 20:19:39.220395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212369 2537 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.212373 2537 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212490 2537 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212494 2537 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212497 2537 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212500 2537 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212503 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212506 2537 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212509 2537 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212511 2537 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212514 2537 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212517 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212520 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212522 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212525 2537 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212527 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212530 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212533 2537 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212535 2537 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212537 2537 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:39.221009 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212540 2537 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212543 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212546 2537 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212548 2537 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212551 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212554 2537 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212556 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212559 2537 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212563 2537 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212566 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212568 2537 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212571 2537 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212575 2537 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212577 2537 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212580 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212582 2537 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212585 2537 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212587 2537 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212590 2537 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:39.221523 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212592 2537 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212595 2537 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212597 2537 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212600 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212602 2537 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212605 2537 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212607 2537 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212610 2537 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212612 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212615 2537 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212618 2537 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212620 2537 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212622 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212626 2537 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212629 2537 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212648 2537 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212652 2537 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212655 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212659 2537 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:39.221997 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212663 2537 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212667 2537 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212671 2537 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212674 2537 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212676 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212679 2537 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212682 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212685 2537 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212687 2537 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212690 2537 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212693 2537 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212695 2537 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212698 2537 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212700 2537 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212703 2537 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212705 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212708 2537 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212710 2537 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212713 2537 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212716 2537 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212718 2537 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:39.222464 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212720 2537 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212723 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212725 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212728 2537 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212730 2537 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212733 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212736 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212738 2537 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212741 2537 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212743 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212747 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212749 2537 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212752 2537 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212756 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212760 2537 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212764 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212767 2537 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212770 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212773 2537 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212777 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:39.222975 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212779 2537 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.212783 2537 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.213629 2537 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.220716 2537 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.220840 2537 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.220861 2537 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.220870 2537 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220926 2537 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220931 2537 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220934 2537 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220937 2537 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220940 2537 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220943 2537 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220947 2537 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220950 2537 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:39.223532 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220953 2537 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220956 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220959 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220962 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220965 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220968 2537 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220971 2537 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220975 2537 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220978 2537 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220982 2537 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220984 2537 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220987 2537 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220990 2537 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220993 2537 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220995 2537 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.220998 2537 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221001 2537 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221003 2537 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221006 2537 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221009 2537 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:39.223911 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221012 2537 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221016 2537 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221019 2537 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221022 2537 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221025 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221028 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221030 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221035 2537 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221039 2537 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221041 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221044 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221048 2537 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221051 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221053 2537 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221056 2537 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221059 2537 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221061 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221064 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221067 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:39.224410 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221069 2537 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221072 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221075 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221078 2537 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221080 2537 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221083 2537 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221086 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221089 2537 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221091 2537 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221094 2537 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221097 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221099 2537 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221102 2537 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221122 2537 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221125 2537 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221130 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221133 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221135 2537 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221138 2537 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221140 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:39.224887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221143 2537 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221146 2537 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221148 2537 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221151 2537 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221154 2537 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221157 2537 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221159 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221162 2537 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221165 2537 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221169 2537 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221173 2537 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221176 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221179 2537 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221182 2537 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221185 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221188 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221191 2537 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221195 2537 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221198 2537 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:39.225488 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221201 2537 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221203 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221206 2537 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221209 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221211 2537 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221214 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221217 2537 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221219 2537 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221222 2537 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221225 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221228 2537 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221230 2537 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221233 2537 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.221238 2537 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221351 2537 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 20:19:39.225951 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221356 2537 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221359 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221362 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221365 2537 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221369 2537 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221373 2537 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221376 2537 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221378 2537 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221381 2537 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221384 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221387 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221390 2537 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221393 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221396 2537 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221399 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221402 2537 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221406 2537 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221409 2537 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221412 2537 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 20:19:39.226325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221415 2537 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221418 2537 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221421 2537 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221424 2537 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221427 2537 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221430 2537 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221432 2537 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221435 2537 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221438 2537 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221441 2537 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221443 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221446 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221448 2537 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221451 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221453 2537 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221456 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221459 2537 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221461 2537 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221464 2537 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 20:19:39.226775 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221466 2537 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221469 2537 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221471 2537 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221474 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221476 2537 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221479 2537 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221481 2537 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221484 2537 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221486 2537 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221489 2537 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221492 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221494 2537 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221497 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221500 2537 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221502 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221505 2537 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221507 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221510 2537 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221513 2537 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221515 2537 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 20:19:39.227254 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221518 2537 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221520 2537 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221524 2537 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221526 2537 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221530 2537 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221532 2537 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221535 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221538 2537 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221540 2537 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221543 2537 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221545 2537 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221548 2537 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221551 2537 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221553 2537 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221556 2537 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221558 2537 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221561 2537 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221563 2537 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221565 2537 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221568 2537 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 20:19:39.227735 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221571 2537 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221573 2537 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221576 2537 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221578 2537 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221581 2537 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221584 2537 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221586 2537 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221589 2537 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221591 2537 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221595 2537 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221599 2537 feature_gate.go:328] unrecognized feature gate: Example Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221602 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221605 2537 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221608 2537 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221610 2537 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221614 2537 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221616 2537 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221619 2537 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221621 2537 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 20:19:39.228250 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:39.221624 2537 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.221629 2537 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.221730 2537 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.224204 2537 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.225516 2537 server.go:1019] "Starting client certificate rotation" Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.225615 2537 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.225679 2537 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 20:19:39.228743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.227833 2537 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:19:39.230590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.230575 2537 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 20:19:39.243028 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.243000 2537 log.go:25] "Validated CRI v1 runtime API" Jun 06 20:19:39.245477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.245458 2537 log.go:25] "Validated CRI v1 image API" Jun 06 20:19:39.246322 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.246303 2537 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 20:19:39.250171 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.250147 2537 fs.go:135] Filesystem UUIDs: map[0de7dff3-b68c-41cf-9d46-97aa64bef1a8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 97042cc9-5918-4761-be10-aac6b3378c8b:/dev/nvme0n1p4] Jun 06 20:19:39.250241 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.250170 2537 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 20:19:39.255997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.255980 2537 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:19:39.256119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.255981 2537 manager.go:216] Machine: {Timestamp:2026-06-06 20:19:39.254698913 +0000 UTC m=+0.331124042 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3149257 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247153125d880fdbbb1ff29721b2d9 SystemUUID:ec247153-125d-880f-dbbb-1ff29721b2d9 BootID:e5cfa86a-0e01-4bf2-b7bd-003303d0f23a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5c:b8:73:a9:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5c:b8:73:a9:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:b2:a3:7e:04:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 20:19:39.256119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.256120 2537 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 20:19:39.256266 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.256253 2537 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 20:19:39.257970 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.257930 2537 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 20:19:39.258142 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.257971 2537 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-27.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 20:19:39.258659 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.258649 2537 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 20:19:39.258693 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.258661 2537 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 20:19:39.258693 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.258669 2537 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:19:39.259310 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.259297 2537 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 20:19:39.260170 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.260159 2537 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 20:19:39.263852 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.263833 2537 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:19:39.263991 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.263980 2537 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 20:19:39.264027 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264011 2537 kubelet.go:486] "Attempting to sync node with API server" Jun 06 20:19:39.264055 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264029 2537 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 20:19:39.264055 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264047 2537 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 20:19:39.264131 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264056 2537 kubelet.go:398] "Adding apiserver pod source" Jun 06 20:19:39.264131 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264071 2537 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 20:19:39.264467 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264456 2537 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:19:39.264512 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.264477 2537 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 20:19:39.266560 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.266540 2537 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 20:19:39.268274 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.268258 2537 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 20:19:39.268329 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.268292 2537 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 20:19:39.269156 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269142 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 20:19:39.269198 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269167 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 20:19:39.269198 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269175 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 20:19:39.269255 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269217 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 20:19:39.269255 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269232 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 20:19:39.269255 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269239 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 20:19:39.269335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269311 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 20:19:39.269335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269316 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 20:19:39.269335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269322 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 20:19:39.269335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269328 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 20:19:39.269445 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269343 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 20:19:39.269445 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.269351 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 20:19:39.270011 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.270002 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 20:19:39.270040 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.270012 2537 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 20:19:39.274248 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.274221 2537 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbbgm" Jun 06 20:19:39.274248 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.274235 2537 server.go:1268] "Started kubelet" Jun 06 20:19:39.274407 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.274271 2537 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 20:19:39.274407 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.274314 2537 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 20:19:39.274407 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.274303 2537 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 20:19:39.275278 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.275256 2537 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-27.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 20:19:39.275390 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.275342 2537 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 20:19:39.275390 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.275346 2537 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-27.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 20:19:39.275310 ip-10-0-131-27 systemd[1]: Started Kubernetes Kubelet. Jun 06 20:19:39.277502 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.277338 2537 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 20:19:39.277603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.277555 2537 server.go:310] "Adding debug handlers to kubelet server" Jun 06 20:19:39.281133 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.281098 2537 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 20:19:39.281560 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.280599 2537 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-27.ec2.internal.18b69768dac2db94 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-27.ec2.internal,UID:ip-10-0-131-27.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-27.ec2.internal,},FirstTimestamp:2026-06-06 20:19:39.2742061 +0000 UTC m=+0.350631230,LastTimestamp:2026-06-06 20:19:39.2742061 +0000 UTC m=+0.350631230,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-27.ec2.internal,}" Jun 06 20:19:39.281794 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.281779 2537 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jbbgm" Jun 06 20:19:39.284318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.284302 2537 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 20:19:39.284397 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.284318 2537 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 20:19:39.284440 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.284411 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.285088 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285071 2537 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 20:19:39.285088 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285087 2537 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 20:19:39.285222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285075 2537 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 20:19:39.285222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285192 2537 reconstruct.go:97] "Volume reconstruction finished" Jun 06 20:19:39.285222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285201 2537 reconciler.go:29] "Reconciler: start to sync state" Jun 06 20:19:39.285421 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285404 2537 factory.go:153] Registering CRI-O factory Jun 06 20:19:39.285421 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285421 2537 factory.go:223] Registration of the crio container factory successfully Jun 06 20:19:39.285577 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285459 2537 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 20:19:39.285577 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285467 2537 factory.go:55] Registering systemd factory Jun 06 20:19:39.285577 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285472 2537 factory.go:223] Registration of the systemd container factory successfully Jun 06 20:19:39.285577 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285492 2537 factory.go:103] Registering Raw factory Jun 06 20:19:39.285577 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285505 2537 manager.go:1196] Started watching for new ooms in manager Jun 06 20:19:39.285938 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.285923 2537 manager.go:349] Starting recovery of all containers Jun 06 20:19:39.293655 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.293635 2537 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:39.297288 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.297268 2537 manager.go:354] Recovery completed Jun 06 20:19:39.297787 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.297768 2537 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.301951 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.301933 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.304404 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.304387 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.304483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.304421 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.304483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.304436 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.305020 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305007 2537 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 20:19:39.305091 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305020 2537 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 20:19:39.305091 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305040 2537 state_mem.go:36] "Initialized new in-memory state store" Jun 06 20:19:39.305195 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305007 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.305772 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305759 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.305816 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305784 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.305816 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.305796 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.306444 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.306432 2537 policy_none.go:49] "None policy: Start" Jun 06 20:19:39.306506 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.306450 2537 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 20:19:39.306506 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.306463 2537 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 20:19:39.307369 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.307357 2537 policy_none.go:47] "Start" Jun 06 20:19:39.341735 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.341720 2537 manager.go:337] "Starting Device Plugin manager" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.341781 2537 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.341794 2537 server.go:87] "Starting device plugin registration server" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.342037 2537 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.342047 2537 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.342157 2537 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.342233 2537 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.342242 2537 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.343189 2537 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 20:19:39.350067 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.343244 2537 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.350408 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.350206 2537 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 20:19:39.351402 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.351385 2537 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 20:19:39.351455 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.351421 2537 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 20:19:39.351455 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.351442 2537 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 20:19:39.351542 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.351519 2537 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 20:19:39.353329 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.353307 2537 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:39.442431 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.442403 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.443469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.443454 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.443543 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.443482 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.443543 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.443492 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.443543 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.443517 2537 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.449561 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.449546 2537 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.449630 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.449569 2537 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-27.ec2.internal\": node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.451746 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.451729 2537 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"] Jun 06 20:19:39.451820 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.451785 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.452547 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.452530 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.452642 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.452561 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.452642 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.452575 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.453849 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.453813 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.453941 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.453927 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.453985 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.453959 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.454581 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.454563 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.454650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.454598 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.454650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.454600 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.454650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.454621 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.454650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.454636 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.454650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.454649 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.455793 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.455779 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.455842 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.455807 2537 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 20:19:39.456533 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.456519 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientMemory" Jun 06 20:19:39.456626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.456541 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 20:19:39.456626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.456551 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeHasSufficientPID" Jun 06 20:19:39.465150 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.465135 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.477767 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.477744 2537 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.481988 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.481968 2537 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-27.ec2.internal\" not found" node="ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.487081 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.487054 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c09d9db1dfc861466d5ad3e724e8c43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"4c09d9db1dfc861466d5ad3e724e8c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.487220 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.487092 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c09d9db1dfc861466d5ad3e724e8c43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"4c09d9db1dfc861466d5ad3e724e8c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.487220 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.487136 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d514af871cbc9d3423e5820a3b7b5aa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"8d514af871cbc9d3423e5820a3b7b5aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.565502 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.565472 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.587882 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.587843 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c09d9db1dfc861466d5ad3e724e8c43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"4c09d9db1dfc861466d5ad3e724e8c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.587997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.587890 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d514af871cbc9d3423e5820a3b7b5aa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"8d514af871cbc9d3423e5820a3b7b5aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.587997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.587917 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c09d9db1dfc861466d5ad3e724e8c43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"4c09d9db1dfc861466d5ad3e724e8c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.587997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.587953 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c09d9db1dfc861466d5ad3e724e8c43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"4c09d9db1dfc861466d5ad3e724e8c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.587997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.587961 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d514af871cbc9d3423e5820a3b7b5aa-config\") pod \"kube-apiserver-proxy-ip-10-0-131-27.ec2.internal\" (UID: \"8d514af871cbc9d3423e5820a3b7b5aa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.587997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.587960 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4c09d9db1dfc861466d5ad3e724e8c43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal\" (UID: \"4c09d9db1dfc861466d5ad3e724e8c43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.666033 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.665996 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.766786 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.766719 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.781882 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.781847 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.785909 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:39.785893 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jun 06 20:19:39.867503 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.867468 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:39.968048 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:39.968024 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:40.068603 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.068525 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:40.169102 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.169072 2537 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-27.ec2.internal\" not found" Jun 06 20:19:40.218161 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.218079 2537 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:40.224912 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.224892 2537 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 20:19:40.225029 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.225006 2537 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:19:40.225086 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.225039 2537 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:19:40.225086 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.225048 2537 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 20:19:40.243095 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.243055 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c09d9db1dfc861466d5ad3e724e8c43.slice/crio-7c6cdabcedb7a35e646e58d8a12c0a4237ce043a0cc9ed01136553cbf2763b9d WatchSource:0}: Error finding container 7c6cdabcedb7a35e646e58d8a12c0a4237ce043a0cc9ed01136553cbf2763b9d: Status 404 returned error can't find the container with id 7c6cdabcedb7a35e646e58d8a12c0a4237ce043a0cc9ed01136553cbf2763b9d Jun 06 20:19:40.243366 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.243350 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d514af871cbc9d3423e5820a3b7b5aa.slice/crio-2b825450ad0fe74c4b63b418e8d190e8869d64c270cdb1a4af825038159baafc WatchSource:0}: Error finding container 2b825450ad0fe74c4b63b418e8d190e8869d64c270cdb1a4af825038159baafc: Status 404 returned error can't find the container with id 2b825450ad0fe74c4b63b418e8d190e8869d64c270cdb1a4af825038159baafc Jun 06 20:19:40.249910 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.249894 2537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:19:40.264723 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.264489 2537 apiserver.go:52] "Watching apiserver" Jun 06 20:19:40.277828 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.277804 2537 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 20:19:40.278736 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.278715 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk","openshift-dns/node-resolver-4dpkw","openshift-image-registry/node-ca-k6x4q","openshift-multus/multus-additional-cni-plugins-8h9vg","openshift-network-operator/iptables-alerter-pzvt6","kube-system/global-pull-secret-syncer-zrs27","kube-system/konnectivity-agent-vkfjh","openshift-cluster-node-tuning-operator/tuned-6dgrz","openshift-multus/multus-p994s","openshift-multus/network-metrics-daemon-sgvqq","openshift-network-diagnostics/network-check-target-b4n8c","openshift-ovn-kubernetes/ovnkube-node-v7bh7"] Jun 06 20:19:40.281341 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.281325 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.282659 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.282625 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.283474 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.283440 2537 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 20:14:39 +0000 UTC" deadline="2028-01-10 11:36:37.566290683 +0000 UTC" Jun 06 20:19:40.283550 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.283474 2537 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13983h16m57.282820178s" Jun 06 20:19:40.283907 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.283892 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 20:19:40.283987 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.283904 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gcph8\"" Jun 06 20:19:40.283987 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.283893 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.283987 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.283893 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.284477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.284445 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.284477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.284459 2537 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 20:19:40.284477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.284472 2537 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" Jun 06 20:19:40.285586 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.285565 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.285755 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.285739 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.285994 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.285979 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bkv9m\"" Jun 06 20:19:40.287358 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.287336 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.287533 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.287510 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 20:19:40.288199 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.288185 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.289639 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.289612 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zkbp2\"" Jun 06 20:19:40.289863 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.289798 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.291390 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291372 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.291550 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291528 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvm5\" (UniqueName: \"kubernetes.io/projected/f298a496-2968-4d0d-8026-0e39b5759b44-kube-api-access-2qvm5\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.291626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291565 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.291626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291615 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.291712 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291644 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcf6n\" (UniqueName: \"kubernetes.io/projected/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-kube-api-access-bcf6n\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.291712 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291670 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbkp\" (UniqueName: \"kubernetes.io/projected/73187db6-5446-4b72-a0b3-ff3be6af2eb8-kube-api-access-pdbkp\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.291712 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291696 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-system-cni-dir\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.291830 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291721 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-os-release\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.291830 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291744 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cni-binary-copy\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.291830 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291766 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-socket-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.291830 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291786 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-device-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.291830 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291803 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73187db6-5446-4b72-a0b3-ff3be6af2eb8-hosts-file\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291824 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cnibin\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291877 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58brs\" (UniqueName: \"kubernetes.io/projected/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-kube-api-access-58brs\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291925 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73187db6-5446-4b72-a0b3-ff3be6af2eb8-tmp-dir\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291961 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f298a496-2968-4d0d-8026-0e39b5759b44-serviceca\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.291990 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292015 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.292043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292040 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-registration-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.292347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292062 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.292347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292086 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-sys-fs\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.292347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292130 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f298a496-2968-4d0d-8026-0e39b5759b44-host\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.292347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292163 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 20:19:40.292347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292182 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 20:19:40.292607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292376 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.292607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292394 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.292607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292406 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 20:19:40.292607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.292376 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dl4s6\"" Jun 06 20:19:40.293514 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.293500 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.293597 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.293533 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wfvtk\"" Jun 06 20:19:40.293597 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.293573 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:40.293717 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.293702 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.293806 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.293791 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 20:19:40.293916 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.293901 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.294601 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.294587 2537 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 20:19:40.295330 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.295317 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.297036 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.297021 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.297440 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.297424 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 20:19:40.297530 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.297439 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bmtsl\"" Jun 06 20:19:40.297688 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.297674 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 20:19:40.299027 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.299011 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p994s" Jun 06 20:19:40.299335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.299316 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wscxr\"" Jun 06 20:19:40.299428 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.299341 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.299428 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.299341 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.300483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.300464 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:40.300581 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.300522 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:40.301334 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.301316 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nctw2\"" Jun 06 20:19:40.301452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.301381 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 20:19:40.301452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.301423 2537 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:19:40.301560 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.301491 2537 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" Jun 06 20:19:40.301686 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.301673 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:40.301739 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.301723 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:40.303058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.303037 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal"] Jun 06 20:19:40.303182 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.303125 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.306053 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.306038 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 20:19:40.306198 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.306039 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 20:19:40.306326 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.306308 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 20:19:40.307672 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.307656 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 20:19:40.307672 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.307663 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 20:19:40.307792 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.307680 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 20:19:40.307792 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.307706 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9f7q7\"" Jun 06 20:19:40.309675 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.309656 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal"] Jun 06 20:19:40.309920 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.309903 2537 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 20:19:40.319900 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.319846 2537 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnrpw" Jun 06 20:19:40.330543 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.330522 2537 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hnrpw" Jun 06 20:19:40.354505 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.354455 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"4c09d9db1dfc861466d5ad3e724e8c43","Type":"ContainerStarted","Data":"7c6cdabcedb7a35e646e58d8a12c0a4237ce043a0cc9ed01136553cbf2763b9d"} Jun 06 20:19:40.355334 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.355309 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"8d514af871cbc9d3423e5820a3b7b5aa","Type":"ContainerStarted","Data":"2b825450ad0fe74c4b63b418e8d190e8869d64c270cdb1a4af825038159baafc"} Jun 06 20:19:40.386587 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.386561 2537 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 20:19:40.392648 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392627 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-conf-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.392734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392653 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.392734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392672 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-systemd-units\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.392734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392690 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cnibin\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.392734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392730 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cnibin\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392729 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392759 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-cni-bin\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392775 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovnkube-script-lib\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392792 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysconfig\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392811 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392827 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-socket-dir-parent\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392841 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-k8s-cni-cncf-io\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392855 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-hostroot\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.392870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392870 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-env-overrides\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392902 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8e2c0d0-8320-461e-a1fc-f72a2fa8c185-konnectivity-ca\") pod \"konnectivity-agent-vkfjh\" (UID: \"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185\") " pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392937 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-etc-kubernetes\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.392991 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qspz\" (UniqueName: \"kubernetes.io/projected/e81bbe4b-afdc-40f2-9874-5f2784bfb322-kube-api-access-5qspz\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393025 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-kubelet\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393051 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393076 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovn-node-metrics-cert\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393103 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-lib-modules\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393140 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-host\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393166 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-os-release\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393191 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73187db6-5446-4b72-a0b3-ff3be6af2eb8-hosts-file\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393213 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/052c120f-2446-4480-90ee-f9820b82bb0d-host-slash\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393221 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-os-release\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393236 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87adf520-cf72-441c-8d54-cd790aec6250-dbus\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393261 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8e2c0d0-8320-461e-a1fc-f72a2fa8c185-agent-certs\") pod \"konnectivity-agent-vkfjh\" (UID: \"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185\") " pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393275 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73187db6-5446-4b72-a0b3-ff3be6af2eb8-hosts-file\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393283 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-system-cni-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.393318 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393322 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393359 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-kubelet\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393382 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393383 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-log-socket\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393435 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysctl-conf\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393452 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-registration-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393468 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393512 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-registration-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393491 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/052c120f-2446-4480-90ee-f9820b82bb0d-iptables-alerter-script\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393577 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393592 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-os-release\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393616 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-cni-bin\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393643 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-sys\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393669 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-tuned\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393694 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4gtj\" (UniqueName: \"kubernetes.io/projected/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-kube-api-access-r4gtj\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393721 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.393988 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393768 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbkp\" (UniqueName: \"kubernetes.io/projected/73187db6-5446-4b72-a0b3-ff3be6af2eb8-kube-api-access-pdbkp\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393871 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87adf520-cf72-441c-8d54-cd790aec6250-kubelet-config\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393899 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-run-netns\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393924 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-system-cni-dir\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393949 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cni-binary-copy\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393971 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-device-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393982 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-system-cni-dir\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.393993 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-cnibin\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394015 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-netns\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394029 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-device-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394039 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-etc-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394067 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovnkube-config\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394123 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysctl-d\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394148 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-slash\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394162 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-systemd\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394180 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58brs\" (UniqueName: \"kubernetes.io/projected/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-kube-api-access-58brs\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394196 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73187db6-5446-4b72-a0b3-ff3be6af2eb8-tmp-dir\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.394932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394211 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrq6r\" (UniqueName: \"kubernetes.io/projected/052c120f-2446-4480-90ee-f9820b82bb0d-kube-api-access-vrq6r\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394226 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81bbe4b-afdc-40f2-9874-5f2784bfb322-cni-binary-copy\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394251 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-cni-multus\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394273 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-modprobe-d\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394297 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f298a496-2968-4d0d-8026-0e39b5759b44-serviceca\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394313 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-ovn\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394328 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-node-log\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394346 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-tmp\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394387 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394416 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fspxd\" (UniqueName: \"kubernetes.io/projected/45defa4b-0edc-4a3f-947f-6c25f55df3f8-kube-api-access-fspxd\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394446 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f298a496-2968-4d0d-8026-0e39b5759b44-host\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394474 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvm5\" (UniqueName: \"kubernetes.io/projected/f298a496-2968-4d0d-8026-0e39b5759b44-kube-api-access-2qvm5\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394475 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73187db6-5446-4b72-a0b3-ff3be6af2eb8-tmp-dir\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394483 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-cni-binary-copy\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394498 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcf6n\" (UniqueName: \"kubernetes.io/projected/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-kube-api-access-bcf6n\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394498 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f298a496-2968-4d0d-8026-0e39b5759b44-host\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394531 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-kubernetes\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.395563 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394562 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-var-lib-kubelet\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394601 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-socket-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394626 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-cni-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394666 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-daemon-config\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394691 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2k9n\" (UniqueName: \"kubernetes.io/projected/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-kube-api-access-g2k9n\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394714 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-systemd\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394718 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-socket-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394731 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f298a496-2968-4d0d-8026-0e39b5759b44-serviceca\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394737 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-run\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394776 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-var-lib-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394748 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394798 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-cni-netd\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394826 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394868 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-sys-fs\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394890 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394898 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.396093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394907 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-multus-certs\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.396559 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394924 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.396559 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.394954 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-sys-fs\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.396559 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.395052 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.399690 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.399672 2537 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 20:19:40.402494 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.402473 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbkp\" (UniqueName: \"kubernetes.io/projected/73187db6-5446-4b72-a0b3-ff3be6af2eb8-kube-api-access-pdbkp\") pod \"node-resolver-4dpkw\" (UID: \"73187db6-5446-4b72-a0b3-ff3be6af2eb8\") " pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.402494 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.402473 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcf6n\" (UniqueName: \"kubernetes.io/projected/59fe2e4c-5d5b-4e25-a1cc-b21db8e56047-kube-api-access-bcf6n\") pod \"multus-additional-cni-plugins-8h9vg\" (UID: \"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047\") " pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.402618 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.402483 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58brs\" (UniqueName: \"kubernetes.io/projected/39f5efb3-bebb-428e-9bb8-d3b09eac2c8b-kube-api-access-58brs\") pod \"aws-ebs-csi-driver-node-x4btk\" (UID: \"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.402618 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.402477 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvm5\" (UniqueName: \"kubernetes.io/projected/f298a496-2968-4d0d-8026-0e39b5759b44-kube-api-access-2qvm5\") pod \"node-ca-k6x4q\" (UID: \"f298a496-2968-4d0d-8026-0e39b5759b44\") " pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.495232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495203 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-conf-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495233 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495250 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-systemd-units\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495268 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495289 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-cni-bin\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495314 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovnkube-script-lib\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495321 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495337 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysconfig\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495349 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-systemd-units\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495325 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-conf-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495376 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-socket-dir-parent\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495381 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysconfig\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.495469 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.495429 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495485 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-k8s-cni-cncf-io\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495501 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-cni-bin\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495510 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-socket-dir-parent\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495550 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-k8s-cni-cncf-io\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.495568 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:40.995532266 +0000 UTC m=+2.071957412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495588 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-hostroot\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495615 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-env-overrides\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495640 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8e2c0d0-8320-461e-a1fc-f72a2fa8c185-konnectivity-ca\") pod \"konnectivity-agent-vkfjh\" (UID: \"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185\") " pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495651 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-hostroot\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495665 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-etc-kubernetes\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495689 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qspz\" (UniqueName: \"kubernetes.io/projected/e81bbe4b-afdc-40f2-9874-5f2784bfb322-kube-api-access-5qspz\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495711 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-kubelet\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495734 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495757 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-etc-kubernetes\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495772 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495790 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-kubelet\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.495855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495854 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovn-node-metrics-cert\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495885 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-lib-modules\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495933 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-host\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495953 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/052c120f-2446-4480-90ee-f9820b82bb0d-host-slash\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495967 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87adf520-cf72-441c-8d54-cd790aec6250-dbus\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.495978 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovnkube-script-lib\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496004 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8e2c0d0-8320-461e-a1fc-f72a2fa8c185-agent-certs\") pod \"konnectivity-agent-vkfjh\" (UID: \"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185\") " pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496009 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-lib-modules\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496030 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-system-cni-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496043 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-host\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496052 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/87adf520-cf72-441c-8d54-cd790aec6250-dbus\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496039 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/052c120f-2446-4480-90ee-f9820b82bb0d-host-slash\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496054 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496090 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-system-cni-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496101 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-kubelet\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496005 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-env-overrides\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496139 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-log-socket\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496160 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysctl-conf\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.496649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496162 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-kubelet\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496177 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/052c120f-2446-4480-90ee-f9820b82bb0d-iptables-alerter-script\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496202 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-log-socket\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496209 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-os-release\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496235 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-cni-bin\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496273 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-cni-bin\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496269 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8e2c0d0-8320-461e-a1fc-f72a2fa8c185-konnectivity-ca\") pod \"konnectivity-agent-vkfjh\" (UID: \"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185\") " pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496310 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-sys\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496325 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-os-release\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496328 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-tuned\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496369 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4gtj\" (UniqueName: \"kubernetes.io/projected/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-kube-api-access-r4gtj\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496399 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87adf520-cf72-441c-8d54-cd790aec6250-kubelet-config\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496369 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysctl-conf\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496423 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-run-netns\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496397 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-sys\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496463 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/87adf520-cf72-441c-8d54-cd790aec6250-kubelet-config\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496465 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-run-netns\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496483 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-cnibin\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.497575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496507 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-netns\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496530 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-etc-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496553 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovnkube-config\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496565 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-cnibin\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496576 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysctl-d\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496600 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-slash\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496607 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-etc-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496625 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-systemd\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496653 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrq6r\" (UniqueName: \"kubernetes.io/projected/052c120f-2446-4480-90ee-f9820b82bb0d-kube-api-access-vrq6r\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496677 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81bbe4b-afdc-40f2-9874-5f2784bfb322-cni-binary-copy\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496700 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-cni-multus\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496713 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/052c120f-2446-4480-90ee-f9820b82bb0d-iptables-alerter-script\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496717 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-slash\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496677 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-netns\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496747 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-modprobe-d\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496780 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-ovn\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496801 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-node-log\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496809 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-systemd\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.498472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496821 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-tmp\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496852 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-modprobe-d\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496854 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496887 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fspxd\" (UniqueName: \"kubernetes.io/projected/45defa4b-0edc-4a3f-947f-6c25f55df3f8-kube-api-access-fspxd\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496919 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-kubernetes\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496943 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-var-lib-kubelet\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496968 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-cni-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.496993 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-daemon-config\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497020 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2k9n\" (UniqueName: \"kubernetes.io/projected/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-kube-api-access-g2k9n\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497043 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-systemd\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497067 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-run\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497077 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovnkube-config\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497090 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-var-lib-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497075 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-var-lib-cni-multus\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497133 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-node-log\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497177 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-cni-netd\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497135 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-cni-netd\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.497202 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:40.499119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497217 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-multus-certs\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497240 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-sysctl-d\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497240 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497265 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497324 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-systemd\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497339 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-cni-dir\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.497257 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:40.997241132 +0000 UTC m=+2.073666250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497377 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e81bbe4b-afdc-40f2-9874-5f2784bfb322-host-run-multus-certs\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497477 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-run\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497518 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-var-lib-openvswitch\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497528 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-kubernetes\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497565 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-var-lib-kubelet\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497564 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e81bbe4b-afdc-40f2-9874-5f2784bfb322-cni-binary-copy\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497639 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-run-ovn\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.497820 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e81bbe4b-afdc-40f2-9874-5f2784bfb322-multus-daemon-config\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.498533 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-etc-tuned\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.498713 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8e2c0d0-8320-461e-a1fc-f72a2fa8c185-agent-certs\") pod \"konnectivity-agent-vkfjh\" (UID: \"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185\") " pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.499611 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.498950 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-ovn-node-metrics-cert\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.500141 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.499093 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-tmp\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.507877 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.507858 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrq6r\" (UniqueName: \"kubernetes.io/projected/052c120f-2446-4480-90ee-f9820b82bb0d-kube-api-access-vrq6r\") pod \"iptables-alerter-pzvt6\" (UID: \"052c120f-2446-4480-90ee-f9820b82bb0d\") " pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.508465 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.508446 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:40.508558 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.508469 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:40.508558 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.508483 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:40.508558 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:40.508532 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:41.008516395 +0000 UTC m=+2.084941529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:40.510779 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.510755 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2k9n\" (UniqueName: \"kubernetes.io/projected/09ea38f0-90ad-4fc1-b42c-6e06c89766c8-kube-api-access-g2k9n\") pod \"ovnkube-node-v7bh7\" (UID: \"09ea38f0-90ad-4fc1-b42c-6e06c89766c8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.511139 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.511124 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4gtj\" (UniqueName: \"kubernetes.io/projected/1f02eb44-efbe-4fd0-a0d9-659992a3e7aa-kube-api-access-r4gtj\") pod \"tuned-6dgrz\" (UID: \"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa\") " pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.511198 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.511178 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qspz\" (UniqueName: \"kubernetes.io/projected/e81bbe4b-afdc-40f2-9874-5f2784bfb322-kube-api-access-5qspz\") pod \"multus-p994s\" (UID: \"e81bbe4b-afdc-40f2-9874-5f2784bfb322\") " pod="openshift-multus/multus-p994s" Jun 06 20:19:40.511271 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.511188 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fspxd\" (UniqueName: \"kubernetes.io/projected/45defa4b-0edc-4a3f-947f-6c25f55df3f8-kube-api-access-fspxd\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:40.593857 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.593756 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" Jun 06 20:19:40.595790 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.595768 2537 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:40.600838 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.600819 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4dpkw" Jun 06 20:19:40.602283 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.602257 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f5efb3_bebb_428e_9bb8_d3b09eac2c8b.slice/crio-b85b2cabd6953a041c61076ec9427722b827b55e5151405cfa3ce8343b7ef929 WatchSource:0}: Error finding container b85b2cabd6953a041c61076ec9427722b827b55e5151405cfa3ce8343b7ef929: Status 404 returned error can't find the container with id b85b2cabd6953a041c61076ec9427722b827b55e5151405cfa3ce8343b7ef929 Jun 06 20:19:40.607484 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.607465 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k6x4q" Jun 06 20:19:40.608270 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.608244 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73187db6_5446_4b72_a0b3_ff3be6af2eb8.slice/crio-bef562fc52fadc15db40a089963c4e479b78b60167c89101754fda34acfb027d WatchSource:0}: Error finding container bef562fc52fadc15db40a089963c4e479b78b60167c89101754fda34acfb027d: Status 404 returned error can't find the container with id bef562fc52fadc15db40a089963c4e479b78b60167c89101754fda34acfb027d Jun 06 20:19:40.611815 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.611799 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" Jun 06 20:19:40.614955 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.614933 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf298a496_2968_4d0d_8026_0e39b5759b44.slice/crio-36d5b9a179d3daeb08c677050c0a6475f2060bce3f5dff59787b82b8a32ef094 WatchSource:0}: Error finding container 36d5b9a179d3daeb08c677050c0a6475f2060bce3f5dff59787b82b8a32ef094: Status 404 returned error can't find the container with id 36d5b9a179d3daeb08c677050c0a6475f2060bce3f5dff59787b82b8a32ef094 Jun 06 20:19:40.619193 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.618080 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pzvt6" Jun 06 20:19:40.619965 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.619939 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fe2e4c_5d5b_4e25_a1cc_b21db8e56047.slice/crio-a862d2c5883fc38d2261fba331d04628aa75b1064a4e635c5b3afbc1ada88bd7 WatchSource:0}: Error finding container a862d2c5883fc38d2261fba331d04628aa75b1064a4e635c5b3afbc1ada88bd7: Status 404 returned error can't find the container with id a862d2c5883fc38d2261fba331d04628aa75b1064a4e635c5b3afbc1ada88bd7 Jun 06 20:19:40.624926 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.624905 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:19:40.626027 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.626007 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052c120f_2446_4480_90ee_f9820b82bb0d.slice/crio-25b4624edcfeb8c6f22dc641bf211851631114f47f407d1ab43b6811fa2b4076 WatchSource:0}: Error finding container 25b4624edcfeb8c6f22dc641bf211851631114f47f407d1ab43b6811fa2b4076: Status 404 returned error can't find the container with id 25b4624edcfeb8c6f22dc641bf211851631114f47f407d1ab43b6811fa2b4076 Jun 06 20:19:40.630464 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.630445 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" Jun 06 20:19:40.633045 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.633008 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e2c0d0_8320_461e_a1fc_f72a2fa8c185.slice/crio-19466fe2ed190b7dfa11965ca1fb215694028d0672d3d6e0094fdbba89776c5c WatchSource:0}: Error finding container 19466fe2ed190b7dfa11965ca1fb215694028d0672d3d6e0094fdbba89776c5c: Status 404 returned error can't find the container with id 19466fe2ed190b7dfa11965ca1fb215694028d0672d3d6e0094fdbba89776c5c Jun 06 20:19:40.636251 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.636234 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p994s" Jun 06 20:19:40.637603 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.637577 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f02eb44_efbe_4fd0_a0d9_659992a3e7aa.slice/crio-d47d685dc5c8f597a70c532299ed0d9454bbec8b34972a65926cf8260fae4e07 WatchSource:0}: Error finding container d47d685dc5c8f597a70c532299ed0d9454bbec8b34972a65926cf8260fae4e07: Status 404 returned error can't find the container with id d47d685dc5c8f597a70c532299ed0d9454bbec8b34972a65926cf8260fae4e07 Jun 06 20:19:40.640546 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:40.640524 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:19:40.645241 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.645210 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81bbe4b_afdc_40f2_9874_5f2784bfb322.slice/crio-351643f87efc3d72d163d61673af78c92039014b8986c944fbf2419c9b1933fa WatchSource:0}: Error finding container 351643f87efc3d72d163d61673af78c92039014b8986c944fbf2419c9b1933fa: Status 404 returned error can't find the container with id 351643f87efc3d72d163d61673af78c92039014b8986c944fbf2419c9b1933fa Jun 06 20:19:40.652733 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:19:40.652699 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ea38f0_90ad_4fc1_b42c_6e06c89766c8.slice/crio-d345231e4fce1e8524f749b80d0e64ce7368390c5178b973691716f6ebe182e9 WatchSource:0}: Error finding container d345231e4fce1e8524f749b80d0e64ce7368390c5178b973691716f6ebe182e9: Status 404 returned error can't find the container with id d345231e4fce1e8524f749b80d0e64ce7368390c5178b973691716f6ebe182e9 Jun 06 20:19:41.000720 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.000645 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:41.000720 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.000707 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:41.000928 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.000854 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:41.000928 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.000916 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:42.000895541 +0000 UTC m=+3.077320700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:41.003204 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.001320 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:41.003204 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.001378 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:42.001361419 +0000 UTC m=+3.077786555 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:41.102050 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.101939 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:41.102242 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.102128 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:41.102242 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.102150 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:41.102242 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.102162 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:41.102242 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:41.102217 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:42.102199812 +0000 UTC m=+3.178624943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:41.332578 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.332482 2537 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:14:40 +0000 UTC" deadline="2028-01-26 17:59:28.757390435 +0000 UTC" Jun 06 20:19:41.332578 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.332524 2537 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14373h39m47.424872028s" Jun 06 20:19:41.343325 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.343100 2537 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:41.384495 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.384452 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"d345231e4fce1e8524f749b80d0e64ce7368390c5178b973691716f6ebe182e9"} Jun 06 20:19:41.415966 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.415871 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vkfjh" event={"ID":"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185","Type":"ContainerStarted","Data":"19466fe2ed190b7dfa11965ca1fb215694028d0672d3d6e0094fdbba89776c5c"} Jun 06 20:19:41.436394 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.436347 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pzvt6" event={"ID":"052c120f-2446-4480-90ee-f9820b82bb0d","Type":"ContainerStarted","Data":"25b4624edcfeb8c6f22dc641bf211851631114f47f407d1ab43b6811fa2b4076"} Jun 06 20:19:41.461951 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.461831 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k6x4q" event={"ID":"f298a496-2968-4d0d-8026-0e39b5759b44","Type":"ContainerStarted","Data":"36d5b9a179d3daeb08c677050c0a6475f2060bce3f5dff59787b82b8a32ef094"} Jun 06 20:19:41.483819 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.483689 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" event={"ID":"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b","Type":"ContainerStarted","Data":"b85b2cabd6953a041c61076ec9427722b827b55e5151405cfa3ce8343b7ef929"} Jun 06 20:19:41.498753 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.498711 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p994s" event={"ID":"e81bbe4b-afdc-40f2-9874-5f2784bfb322","Type":"ContainerStarted","Data":"351643f87efc3d72d163d61673af78c92039014b8986c944fbf2419c9b1933fa"} Jun 06 20:19:41.505008 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.504946 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" event={"ID":"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa","Type":"ContainerStarted","Data":"d47d685dc5c8f597a70c532299ed0d9454bbec8b34972a65926cf8260fae4e07"} Jun 06 20:19:41.510497 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.510399 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerStarted","Data":"a862d2c5883fc38d2261fba331d04628aa75b1064a4e635c5b3afbc1ada88bd7"} Jun 06 20:19:41.524593 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.524547 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dpkw" event={"ID":"73187db6-5446-4b72-a0b3-ff3be6af2eb8","Type":"ContainerStarted","Data":"bef562fc52fadc15db40a089963c4e479b78b60167c89101754fda34acfb027d"} Jun 06 20:19:41.759123 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:41.758842 2537 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:42.010093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.009991 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:42.010093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.010061 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:42.010338 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.010202 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:42.010338 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.010228 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:42.010338 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.010301 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:44.010279798 +0000 UTC m=+5.086704934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:42.010338 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.010324 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:44.010314287 +0000 UTC m=+5.086739417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:42.110648 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.110609 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:42.110838 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.110802 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:42.110838 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.110825 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:42.110838 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.110839 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:42.110999 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.110899 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:44.110880599 +0000 UTC m=+5.187305734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:42.333046 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.332937 2537 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 20:14:40 +0000 UTC" deadline="2027-12-04 13:47:11.186356588 +0000 UTC" Jun 06 20:19:42.333046 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.333000 2537 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13097h27m28.853360475s" Jun 06 20:19:42.352528 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.352494 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:42.352683 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.352620 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:42.353056 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.353032 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:42.353405 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.353193 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:42.353405 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.353301 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:42.353629 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:42.353526 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:42.636491 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:42.636402 2537 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 20:19:44.029520 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:44.029373 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:44.029520 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:44.029467 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:44.029520 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.029512 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:44.030065 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.029543 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:44.030065 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.029585 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:48.029567223 +0000 UTC m=+9.105992355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:44.030065 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.029606 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:48.029595273 +0000 UTC m=+9.106020405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:44.130450 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:44.130411 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:44.130694 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.130654 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:44.130694 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.130681 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:44.130694 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.130696 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:44.130857 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.130758 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:48.130739825 +0000 UTC m=+9.207164963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:44.353247 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:44.352650 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:44.353247 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.352777 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:44.353247 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:44.353148 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:44.353247 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:44.353162 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:44.353577 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.353260 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:44.353577 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:44.353361 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:46.352421 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:46.352387 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:46.352888 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:46.352428 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:46.352888 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:46.352428 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:46.352888 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:46.352553 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:46.352888 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:46.352659 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:46.352888 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:46.352743 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:48.062312 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:48.062201 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:48.062312 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:48.062257 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:48.062806 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.062371 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:48.062806 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.062429 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:56.06241113 +0000 UTC m=+17.138836250 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:48.062806 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.062371 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:48.062806 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.062773 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:56.062756942 +0000 UTC m=+17.139182063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:48.163338 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:48.163300 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:48.163501 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.163480 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:48.163539 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.163510 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:48.163539 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.163523 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:48.163610 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.163579 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:19:56.163560817 +0000 UTC m=+17.239985947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:48.352355 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:48.351758 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:48.352355 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:48.351795 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:48.352355 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:48.351758 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:48.352355 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.351897 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:48.352355 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.351983 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:48.352355 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:48.352071 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:49.361165 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:49.360319 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:49.361165 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:49.360485 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:50.352235 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:50.352146 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:50.352235 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:50.352195 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:50.352451 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:50.352278 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:50.352507 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:50.352461 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:51.351880 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:51.351846 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:51.352350 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:51.351977 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:52.352524 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:52.352457 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:52.352524 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:52.352473 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:52.352992 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:52.352567 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:52.352992 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:52.352673 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:53.358528 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:53.358500 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:53.359018 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:53.358593 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:54.351725 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:54.351694 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:54.351925 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:54.351707 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:54.351925 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:54.351823 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:54.351925 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:54.351911 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:55.355143 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:55.355102 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:55.355533 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:55.355213 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:56.116994 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:56.116957 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:56.117225 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:56.117054 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:56.117225 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.117138 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:56.117225 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.117177 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:56.117225 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.117208 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:12.11719213 +0000 UTC m=+33.193617250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:19:56.117405 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.117231 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:12.117213735 +0000 UTC m=+33.193638869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:19:56.218423 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:56.218380 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:56.218580 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.218554 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:19:56.218639 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.218582 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:19:56.218639 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.218592 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:56.218713 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.218654 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:12.218638108 +0000 UTC m=+33.295063237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:19:56.351944 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:56.351903 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:56.351944 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:56.351933 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:56.352187 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.352046 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:56.352187 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:56.352164 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:57.352066 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:57.352032 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:57.352542 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:57.352184 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:19:58.352155 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:58.352104 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:19:58.352601 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:58.352242 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:19:58.352601 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:58.352280 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:19:58.352601 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:58.352356 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:19:59.352977 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:19:59.352944 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:19:59.353460 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:19:59.353045 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:00.351578 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:00.351550 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:00.351748 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:00.351548 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:00.351748 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:00.351655 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:00.351833 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:00.351741 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:01.351852 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.351813 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:01.352492 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:01.351966 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:01.574098 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.573929 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:20:01.574561 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.574540 2537 generic.go:356] "Generic (PLEG): container finished" podID="09ea38f0-90ad-4fc1-b42c-6e06c89766c8" containerID="46f45e51e029d6153265f683d802b994a02649b21ff199254dde26d42d5173db" exitCode=1 Jun 06 20:20:01.574659 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.574612 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"45698ba41c4b4a8f1e130e3c73fece875fa4cb60f7e7d4079b3bc87a8773aa39"} Jun 06 20:20:01.574720 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.574694 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerDied","Data":"46f45e51e029d6153265f683d802b994a02649b21ff199254dde26d42d5173db"} Jun 06 20:20:01.574774 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.574732 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"6d1a8cb9613e9b1f7dc4206f6d8056396484547d407b80283610d60c496c9a2e"} Jun 06 20:20:01.575990 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.575968 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" event={"ID":"8d514af871cbc9d3423e5820a3b7b5aa","Type":"ContainerStarted","Data":"063aa91d3bcc345364b62cac41e3d81331460b2bae355e69c6dd90da41d7df24"} Jun 06 20:20:01.577341 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.577321 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p994s" event={"ID":"e81bbe4b-afdc-40f2-9874-5f2784bfb322","Type":"ContainerStarted","Data":"645450121b02d58df92278248ec62487b7c191aad9195f55e1c31e58791258a8"} Jun 06 20:20:01.578675 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.578655 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" event={"ID":"1f02eb44-efbe-4fd0-a0d9-659992a3e7aa","Type":"ContainerStarted","Data":"1c02f9dc327d46a6649d200b6d85a4881b600e9fbb5328a39769262bae1cd709"} Jun 06 20:20:01.589922 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.589879 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-27.ec2.internal" podStartSLOduration=21.589867468 podStartE2EDuration="21.589867468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:01.589384476 +0000 UTC m=+22.665809626" watchObservedRunningTime="2026-06-06 20:20:01.589867468 +0000 UTC m=+22.666292616" Jun 06 20:20:01.604335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.604294 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6dgrz" podStartSLOduration=2.5874751959999998 podStartE2EDuration="22.604279491s" totalImagesPullingTime="20.016804295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:01.604102845 +0000 UTC m=+22.680527983" watchObservedRunningTime="2026-06-06 20:20:01.604279491 +0000 UTC m=+22.680704630" Jun 06 20:20:01.619839 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:01.619796 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p994s" podStartSLOduration=2.591589006 podStartE2EDuration="22.619782371s" totalImagesPullingTime="20.028193365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:01.619716504 +0000 UTC m=+22.696141645" watchObservedRunningTime="2026-06-06 20:20:01.619782371 +0000 UTC m=+22.696207509" Jun 06 20:20:02.351800 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.351760 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:02.351996 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:02.351871 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:02.351996 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.351927 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:02.352517 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:02.352041 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:02.583045 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.583003 2537 generic.go:356] "Generic (PLEG): container finished" podID="4c09d9db1dfc861466d5ad3e724e8c43" containerID="73804d3b423cf3088315bb7c24941421a16970f7d68e8f066690b1a105c5250f" exitCode=0 Jun 06 20:20:02.583283 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.583084 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"4c09d9db1dfc861466d5ad3e724e8c43","Type":"ContainerDied","Data":"73804d3b423cf3088315bb7c24941421a16970f7d68e8f066690b1a105c5250f"} Jun 06 20:20:02.585004 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.584974 2537 generic.go:356] "Generic (PLEG): container finished" podID="59fe2e4c-5d5b-4e25-a1cc-b21db8e56047" containerID="a76a0a0d7638777ea22f1f24ea9062de8cd3af20db8b61dfbd2733468681ebb2" exitCode=0 Jun 06 20:20:02.585139 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.585057 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerDied","Data":"a76a0a0d7638777ea22f1f24ea9062de8cd3af20db8b61dfbd2733468681ebb2"} Jun 06 20:20:02.587019 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.586995 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4dpkw" event={"ID":"73187db6-5446-4b72-a0b3-ff3be6af2eb8","Type":"ContainerStarted","Data":"12f57e72e2ba6880f28649aaf0d4647399a5ee1041380c071871c312f88eda53"} Jun 06 20:20:02.590255 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.590233 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:20:02.590621 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.590602 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"cabff65a9a6581437558f0fb4f3239ba918889395be19b502ebfce781cf2fcb7"} Jun 06 20:20:02.590703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.590673 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"b1e199425f6e3074adce535f7bf0162559ab40e172d9cfcd08439d329d278792"} Jun 06 20:20:02.590769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.590725 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"023de69b32a023ea5aa9e795534d60d26af1100a660bbb740387e2b0f9ebf3ca"} Jun 06 20:20:02.592147 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.592048 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vkfjh" event={"ID":"f8e2c0d0-8320-461e-a1fc-f72a2fa8c185","Type":"ContainerStarted","Data":"8ec054dfa2aa189f5f971c31e36df7bb182cdf5b119eb79361828b49d5cba2de"} Jun 06 20:20:02.593516 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.593492 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pzvt6" event={"ID":"052c120f-2446-4480-90ee-f9820b82bb0d","Type":"ContainerStarted","Data":"2b77ae4e85c1f4574af6b3e7e8ed5bc52f1494d0defb4c98a8641715e6c47f4c"} Jun 06 20:20:02.595042 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.595013 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k6x4q" event={"ID":"f298a496-2968-4d0d-8026-0e39b5759b44","Type":"ContainerStarted","Data":"c08f5af249753d77ce3841b3e1bd4d5ecb858e153a643dcb1905d10d2184a176"} Jun 06 20:20:02.596625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.596595 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" event={"ID":"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b","Type":"ContainerStarted","Data":"20d58fe462ba822a614ee9d36ab18222f478edcd5b91f8085c16d2a2cf7420f2"} Jun 06 20:20:02.611874 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.611798 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4dpkw" podStartSLOduration=3.566531333 podStartE2EDuration="23.611783021s" totalImagesPullingTime="20.045251688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:02.611382769 +0000 UTC m=+23.687807908" watchObservedRunningTime="2026-06-06 20:20:02.611783021 +0000 UTC m=+23.688208160" Jun 06 20:20:02.625996 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.625673 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k6x4q" podStartSLOduration=3.586227166 podStartE2EDuration="23.625657855s" totalImagesPullingTime="20.039430689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:02.625226552 +0000 UTC m=+23.701651692" watchObservedRunningTime="2026-06-06 20:20:02.625657855 +0000 UTC m=+23.702082994" Jun 06 20:20:02.638422 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.638349 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pzvt6" podStartSLOduration=3.610563214 podStartE2EDuration="23.63832816s" totalImagesPullingTime="20.027764946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:02.638272418 +0000 UTC m=+23.714697559" watchObservedRunningTime="2026-06-06 20:20:02.63832816 +0000 UTC m=+23.714753301" Jun 06 20:20:02.657893 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:02.657792 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vkfjh" podStartSLOduration=3.636614211 podStartE2EDuration="23.657772342s" totalImagesPullingTime="20.021158131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:02.657741915 +0000 UTC m=+23.734167057" watchObservedRunningTime="2026-06-06 20:20:02.657772342 +0000 UTC m=+23.734197484" Jun 06 20:20:03.352094 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:03.351826 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:03.352522 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:03.352124 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:03.366227 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:03.366178 2537 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 20:20:03.601265 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:03.601226 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" event={"ID":"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b","Type":"ContainerStarted","Data":"276677cc03e8f40c2e38a0ce2071bcc391c4951c27201afc0c245be82b9f3f51"} Jun 06 20:20:03.603387 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:03.603346 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" event={"ID":"4c09d9db1dfc861466d5ad3e724e8c43","Type":"ContainerStarted","Data":"927de6e4f76bb641e23a9a188a13e2dd0de5cac247a35c2a93394a45c10fb91d"} Jun 06 20:20:03.618677 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:03.618628 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-27.ec2.internal" podStartSLOduration=23.618610557 podStartE2EDuration="23.618610557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:03.618218489 +0000 UTC m=+24.694643649" watchObservedRunningTime="2026-06-06 20:20:03.618610557 +0000 UTC m=+24.695035697" Jun 06 20:20:04.352649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.352614 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:04.353309 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.352614 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:04.353309 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:04.352768 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:04.353309 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:04.352814 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:04.354731 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.354646 2537 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T20:20:03.366202315Z","UUID":"4188f9ed-30a9-4e9d-be70-aeef1f626cd6","Handler":null,"Name":"","Endpoint":""} Jun 06 20:20:04.356168 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.356149 2537 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 20:20:04.356275 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.356190 2537 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 20:20:04.613366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.613278 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:20:04.613750 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.613705 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"6a5ce0d75b4531cad9eea1c16604f0aa130ad581c970db8b376b9f5ab569c0e9"} Jun 06 20:20:04.616153 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.616094 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" event={"ID":"39f5efb3-bebb-428e-9bb8-d3b09eac2c8b","Type":"ContainerStarted","Data":"bc7b5ccef713403ad5466174b20c2a0be71074bf0a6989b8426e1a211ea8753c"} Jun 06 20:20:04.633890 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:04.633837 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x4btk" podStartSLOduration=3.403639049 podStartE2EDuration="25.633824488s" totalImagesPullingTime="22.230185439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:04.633520527 +0000 UTC m=+25.709945669" watchObservedRunningTime="2026-06-06 20:20:04.633824488 +0000 UTC m=+25.710249627" Jun 06 20:20:05.145259 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:05.145226 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:20:05.145768 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:05.145752 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:20:05.241769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:05.241737 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:20:05.242863 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:05.242840 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vkfjh" Jun 06 20:20:05.352160 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:05.352120 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:05.352337 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:05.352241 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:06.351721 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:06.351650 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:06.352271 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:06.351657 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:06.352271 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:06.351758 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:06.352271 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:06.351853 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:07.351870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.351644 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:07.352248 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:07.351898 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:07.625416 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.625339 2537 generic.go:356] "Generic (PLEG): container finished" podID="59fe2e4c-5d5b-4e25-a1cc-b21db8e56047" containerID="7d0869c40136095d9bb3779f531704f33d6e2b6b40df95761fbe2e2fed63594a" exitCode=0 Jun 06 20:20:07.625416 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.625407 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerDied","Data":"7d0869c40136095d9bb3779f531704f33d6e2b6b40df95761fbe2e2fed63594a"} Jun 06 20:20:07.629136 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.629103 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:20:07.629501 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.629476 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"8a8891a05178eb62ebe7fba0e20211878aac052e473708a95033845e6da1ceb1"} Jun 06 20:20:07.629724 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.629712 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:20:07.629871 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.629857 2537 scope.go:117] "RemoveContainer" containerID="46f45e51e029d6153265f683d802b994a02649b21ff199254dde26d42d5173db" Jun 06 20:20:07.650450 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:07.650431 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:20:08.352635 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.352603 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:08.353190 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:08.352730 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:08.353190 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.352770 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:08.353190 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:08.352870 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:08.636218 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.636025 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:20:08.636637 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.636610 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" event={"ID":"09ea38f0-90ad-4fc1-b42c-6e06c89766c8","Type":"ContainerStarted","Data":"a6230ecd6040fefa801feff7f1ec793eada5e7a6b4198b308b166615a9f98ca5"} Jun 06 20:20:08.636886 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.636868 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:20:08.636984 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.636974 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:20:08.653836 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.653813 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:20:08.663270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.663228 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" podStartSLOduration=9.195974404 podStartE2EDuration="29.663213628s" totalImagesPullingTime="20.467239224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:08.661993418 +0000 UTC m=+29.738418557" watchObservedRunningTime="2026-06-06 20:20:08.663213628 +0000 UTC m=+29.739638766" Jun 06 20:20:08.833260 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.833228 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrs27"] Jun 06 20:20:08.833438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.833335 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:08.833491 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:08.833415 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:08.838335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.837979 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b4n8c"] Jun 06 20:20:08.838335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.838076 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sgvqq"] Jun 06 20:20:08.838335 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.838191 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:08.838576 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:08.838331 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:08.838576 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:08.838406 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:08.838806 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:08.838781 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:09.643303 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:09.643269 2537 generic.go:356] "Generic (PLEG): container finished" podID="59fe2e4c-5d5b-4e25-a1cc-b21db8e56047" containerID="c5a9d5250a11ca02b124e881dad799763c80e0ec32360ef52871d82c24ebbc2a" exitCode=0 Jun 06 20:20:09.643904 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:09.643360 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerDied","Data":"c5a9d5250a11ca02b124e881dad799763c80e0ec32360ef52871d82c24ebbc2a"} Jun 06 20:20:10.352387 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:10.352348 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:10.352387 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:10.352389 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:10.352595 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:10.352388 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:10.352595 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:10.352473 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:10.352595 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:10.352563 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:10.352696 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:10.352658 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:11.650063 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:11.650022 2537 generic.go:356] "Generic (PLEG): container finished" podID="59fe2e4c-5d5b-4e25-a1cc-b21db8e56047" containerID="3fdb5333a48c9f3d0ca0df4427312b5de4528913cfedd5070d932e4f874c763d" exitCode=0 Jun 06 20:20:11.650773 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:11.650086 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerDied","Data":"3fdb5333a48c9f3d0ca0df4427312b5de4528913cfedd5070d932e4f874c763d"} Jun 06 20:20:12.139222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:12.139191 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:12.139222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:12.139234 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:12.139421 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.139326 2537 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 20:20:12.139421 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.139330 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:20:12.139421 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.139389 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret podName:87adf520-cf72-441c-8d54-cd790aec6250 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:44.139373968 +0000 UTC m=+65.215799084 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret") pod "global-pull-secret-syncer-zrs27" (UID: "87adf520-cf72-441c-8d54-cd790aec6250") : object "kube-system"/"original-pull-secret" not registered Jun 06 20:20:12.139421 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.139403 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:44.139397508 +0000 UTC m=+65.215822625 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 20:20:12.240232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:12.240176 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:12.240417 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.240338 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 20:20:12.240417 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.240357 2537 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 20:20:12.240417 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.240367 2537 projected.go:196] Error preparing data for projected volume kube-api-access-9wrlq for pod openshift-network-diagnostics/network-check-target-b4n8c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:20:12.240557 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.240422 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq podName:2095f1a4-5743-4e1a-8039-513e1908a738 nodeName:}" failed. No retries permitted until 2026-06-06 20:20:44.240405086 +0000 UTC m=+65.316830207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9wrlq" (UniqueName: "kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq") pod "network-check-target-b4n8c" (UID: "2095f1a4-5743-4e1a-8039-513e1908a738") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 20:20:12.352671 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:12.352591 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:12.352855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:12.352591 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:12.352855 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.352718 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zrs27" podUID="87adf520-cf72-441c-8d54-cd790aec6250" Jun 06 20:20:12.352855 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:12.352591 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:12.352855 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.352782 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b4n8c" podUID="2095f1a4-5743-4e1a-8039-513e1908a738" Jun 06 20:20:12.353028 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:12.352885 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:20:13.753779 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.753755 2537 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-27.ec2.internal" event="NodeReady" Jun 06 20:20:13.754167 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.753894 2537 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 20:20:13.796817 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.796786 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7crdx"] Jun 06 20:20:13.799418 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.799380 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:13.799762 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.799726 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ktlcq"] Jun 06 20:20:13.802141 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.802095 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 20:20:13.802356 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.802149 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wqmlq\"" Jun 06 20:20:13.802356 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.802254 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:13.803443 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.803395 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 20:20:13.806149 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.806126 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 20:20:13.806254 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.806206 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hpmf7\"" Jun 06 20:20:13.806309 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.806261 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 20:20:13.806363 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.806310 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 20:20:13.810255 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.809867 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7crdx"] Jun 06 20:20:13.813568 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.813542 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ktlcq"] Jun 06 20:20:13.953290 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.953249 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf504e7d-2b68-4404-96cb-3148b414abfb-config-volume\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:13.953290 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.953294 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf504e7d-2b68-4404-96cb-3148b414abfb-tmp-dir\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:13.953522 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.953356 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzsn\" (UniqueName: \"kubernetes.io/projected/d9fa04f6-dea5-4f93-bc17-bd260da5d3ed-kube-api-access-9hzsn\") pod \"ingress-canary-ktlcq\" (UID: \"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed\") " pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:13.953522 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.953416 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz29x\" (UniqueName: \"kubernetes.io/projected/cf504e7d-2b68-4404-96cb-3148b414abfb-kube-api-access-sz29x\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:13.953522 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.953447 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:13.953522 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:13.953462 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9fa04f6-dea5-4f93-bc17-bd260da5d3ed-cert\") pod \"ingress-canary-ktlcq\" (UID: \"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed\") " pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:14.054614 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.054529 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz29x\" (UniqueName: \"kubernetes.io/projected/cf504e7d-2b68-4404-96cb-3148b414abfb-kube-api-access-sz29x\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.054614 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.054577 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.054614 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.054603 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9fa04f6-dea5-4f93-bc17-bd260da5d3ed-cert\") pod \"ingress-canary-ktlcq\" (UID: \"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed\") " pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:14.054882 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.054649 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf504e7d-2b68-4404-96cb-3148b414abfb-config-volume\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.054882 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.054683 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf504e7d-2b68-4404-96cb-3148b414abfb-tmp-dir\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.054882 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.054720 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzsn\" (UniqueName: \"kubernetes.io/projected/d9fa04f6-dea5-4f93-bc17-bd260da5d3ed-kube-api-access-9hzsn\") pod \"ingress-canary-ktlcq\" (UID: \"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed\") " pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:14.054882 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:14.054684 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:14.054882 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:14.054867 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:20:14.554845659 +0000 UTC m=+35.631270781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:14.055101 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.055022 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf504e7d-2b68-4404-96cb-3148b414abfb-tmp-dir\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.055279 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.055262 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cf504e7d-2b68-4404-96cb-3148b414abfb-config-volume\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.059057 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.058889 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d9fa04f6-dea5-4f93-bc17-bd260da5d3ed-cert\") pod \"ingress-canary-ktlcq\" (UID: \"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed\") " pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:14.063248 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.063222 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz29x\" (UniqueName: \"kubernetes.io/projected/cf504e7d-2b68-4404-96cb-3148b414abfb-kube-api-access-sz29x\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.063435 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.063412 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzsn\" (UniqueName: \"kubernetes.io/projected/d9fa04f6-dea5-4f93-bc17-bd260da5d3ed-kube-api-access-9hzsn\") pod \"ingress-canary-ktlcq\" (UID: \"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed\") " pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:14.121877 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.121844 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ktlcq" Jun 06 20:20:14.263648 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.263604 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ktlcq"] Jun 06 20:20:14.267887 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:20:14.267861 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fa04f6_dea5_4f93_bc17_bd260da5d3ed.slice/crio-1fd8d4a49ffc4775a8c63695b942caed3d840438d7a36f25945f801c23eaeccf WatchSource:0}: Error finding container 1fd8d4a49ffc4775a8c63695b942caed3d840438d7a36f25945f801c23eaeccf: Status 404 returned error can't find the container with id 1fd8d4a49ffc4775a8c63695b942caed3d840438d7a36f25945f801c23eaeccf Jun 06 20:20:14.352610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.352536 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:14.352766 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.352536 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:14.352843 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.352536 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:14.356333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.356178 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:20:14.356333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.356198 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:20:14.356333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.356210 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wj9j\"" Jun 06 20:20:14.356333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.356226 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:20:14.356333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.356275 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rxmgp\"" Jun 06 20:20:14.356333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.356217 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:20:14.560353 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.560310 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:14.560523 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:14.560427 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:14.560578 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:14.560522 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:20:15.560498345 +0000 UTC m=+36.636923464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:14.657205 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:14.657132 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ktlcq" event={"ID":"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed","Type":"ContainerStarted","Data":"1fd8d4a49ffc4775a8c63695b942caed3d840438d7a36f25945f801c23eaeccf"} Jun 06 20:20:15.568336 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:15.568299 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:15.568852 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:15.568466 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:15.568852 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:15.568535 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:20:17.568514962 +0000 UTC m=+38.644940101 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:17.584363 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:17.584327 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:17.584741 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:17.584480 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:17.584741 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:17.584541 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:20:21.584523975 +0000 UTC m=+42.660949100 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:17.667948 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:17.667911 2537 generic.go:356] "Generic (PLEG): container finished" podID="59fe2e4c-5d5b-4e25-a1cc-b21db8e56047" containerID="f0b2c3891630f1681de9c2923db2e0e3ee0087d2c8e64cd864eeecd43b3e47f3" exitCode=0 Jun 06 20:20:17.668140 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:17.667958 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerDied","Data":"f0b2c3891630f1681de9c2923db2e0e3ee0087d2c8e64cd864eeecd43b3e47f3"} Jun 06 20:20:17.669479 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:17.669447 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ktlcq" event={"ID":"d9fa04f6-dea5-4f93-bc17-bd260da5d3ed","Type":"ContainerStarted","Data":"cd8fe490998d937642f127abe5a21878ef1ebec7699149bc15b70864f2dca485"} Jun 06 20:20:17.705654 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:17.705596 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ktlcq" podStartSLOduration=1.626239115 podStartE2EDuration="4.705574623s" totalImagesPullingTime="3.079335508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:17.704343845 +0000 UTC m=+38.780768986" watchObservedRunningTime="2026-06-06 20:20:17.705574623 +0000 UTC m=+38.781999762" Jun 06 20:20:18.675210 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:18.675102 2537 generic.go:356] "Generic (PLEG): container finished" podID="59fe2e4c-5d5b-4e25-a1cc-b21db8e56047" containerID="8d8779b3f15f6f0e1f5f4914dd77766976659058c3f80e2286c7524ac2e63e14" exitCode=0 Jun 06 20:20:18.675844 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:18.675200 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerDied","Data":"8d8779b3f15f6f0e1f5f4914dd77766976659058c3f80e2286c7524ac2e63e14"} Jun 06 20:20:19.683239 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:19.683203 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" event={"ID":"59fe2e4c-5d5b-4e25-a1cc-b21db8e56047","Type":"ContainerStarted","Data":"158dadaa66015d506dc16ae45f739c914f768bcf77b4a4324ab85562e72217dd"} Jun 06 20:20:19.705695 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:19.705645 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8h9vg" podStartSLOduration=8.706443191 podStartE2EDuration="40.705629475s" totalImagesPullingTime="31.999186284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:19.703907645 +0000 UTC m=+40.780332783" watchObservedRunningTime="2026-06-06 20:20:19.705629475 +0000 UTC m=+40.782054614" Jun 06 20:20:21.613207 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:21.613170 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:21.613573 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:21.613307 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:21.613573 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:21.613358 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:20:29.613344956 +0000 UTC m=+50.689770073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:29.664478 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:29.664434 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:29.665059 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:29.664569 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:29.665059 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:29.664621 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:20:45.664607299 +0000 UTC m=+66.741032416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:40.655596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:40.655568 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7bh7" Jun 06 20:20:44.165435 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.165386 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:44.165834 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.165471 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:20:44.167990 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.167970 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 20:20:44.168040 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.167999 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 20:20:44.176004 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:44.175985 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:20:44.176049 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:44.176038 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:21:48.176024292 +0000 UTC m=+129.252449421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : secret "metrics-daemon-secret" not found Jun 06 20:20:44.178920 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.178885 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/87adf520-cf72-441c-8d54-cd790aec6250-original-pull-secret\") pod \"global-pull-secret-syncer-zrs27\" (UID: \"87adf520-cf72-441c-8d54-cd790aec6250\") " pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:44.266210 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.266161 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:44.269057 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.269040 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 20:20:44.279442 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.279417 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 20:20:44.289870 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.289844 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wrlq\" (UniqueName: \"kubernetes.io/projected/2095f1a4-5743-4e1a-8039-513e1908a738-kube-api-access-9wrlq\") pod \"network-check-target-b4n8c\" (UID: \"2095f1a4-5743-4e1a-8039-513e1908a738\") " pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:44.367935 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.367902 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rxmgp\"" Jun 06 20:20:44.371151 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.371126 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zrs27" Jun 06 20:20:44.376057 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.376041 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:44.505060 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.505032 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zrs27"] Jun 06 20:20:44.521648 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.521623 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b4n8c"] Jun 06 20:20:44.525694 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:20:44.525669 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2095f1a4_5743_4e1a_8039_513e1908a738.slice/crio-0a3d07e13e86a0af9cbd9d24540cad8a3addaa1f2d76b419fb28ed0e4091ecba WatchSource:0}: Error finding container 0a3d07e13e86a0af9cbd9d24540cad8a3addaa1f2d76b419fb28ed0e4091ecba: Status 404 returned error can't find the container with id 0a3d07e13e86a0af9cbd9d24540cad8a3addaa1f2d76b419fb28ed0e4091ecba Jun 06 20:20:44.742163 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.742132 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b4n8c" event={"ID":"2095f1a4-5743-4e1a-8039-513e1908a738","Type":"ContainerStarted","Data":"0a3d07e13e86a0af9cbd9d24540cad8a3addaa1f2d76b419fb28ed0e4091ecba"} Jun 06 20:20:44.743036 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:44.743011 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrs27" event={"ID":"87adf520-cf72-441c-8d54-cd790aec6250","Type":"ContainerStarted","Data":"f8abfcd7ac5a0de7a5f3d6fa74b86712cc6ba7924f03347779bfe696f8971ebf"} Jun 06 20:20:45.674969 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:45.674863 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:20:45.675491 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:45.675062 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:20:45.675491 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:20:45.675127 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:21:17.675100639 +0000 UTC m=+98.751525760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:20:49.758776 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:49.758737 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b4n8c" event={"ID":"2095f1a4-5743-4e1a-8039-513e1908a738","Type":"ContainerStarted","Data":"c03306e051166f626b020a09fbc8e7658afa9ca9271bc70e6dbb0cb4f0cf9655"} Jun 06 20:20:49.759242 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:49.758868 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:20:49.760137 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:49.760093 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zrs27" event={"ID":"87adf520-cf72-441c-8d54-cd790aec6250","Type":"ContainerStarted","Data":"b99e818323693e06b3bc71d9574fdad7132e4b501a4ce0c3eeab91bf203d62bb"} Jun 06 20:20:49.774125 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:49.774066 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b4n8c" podStartSLOduration=66.567227578 podStartE2EDuration="1m10.7740508s" totalImagesPullingTime="4.206823222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:49.773756248 +0000 UTC m=+70.850181378" watchObservedRunningTime="2026-06-06 20:20:49.7740508 +0000 UTC m=+70.850475937" Jun 06 20:20:49.786908 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:20:49.786867 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zrs27" podStartSLOduration=66.558424556 podStartE2EDuration="1m10.786854662s" totalImagesPullingTime="4.228430106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:20:49.786454914 +0000 UTC m=+70.862880055" watchObservedRunningTime="2026-06-06 20:20:49.786854662 +0000 UTC m=+70.863279800" Jun 06 20:21:17.686185 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:21:17.686144 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:21:17.686666 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:21:17.686293 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:21:17.686666 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:21:17.686369 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:22:21.686353906 +0000 UTC m=+162.762779028 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:21:20.765435 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:21:20.765406 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b4n8c" Jun 06 20:21:48.194631 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:21:48.194572 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:21:48.195054 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:21:48.194747 2537 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 20:21:48.195054 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:21:48.194830 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs podName:45defa4b-0edc-4a3f-947f-6c25f55df3f8 nodeName:}" failed. No retries permitted until 2026-06-06 20:23:50.194812161 +0000 UTC m=+251.271237282 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs") pod "network-metrics-daemon-sgvqq" (UID: "45defa4b-0edc-4a3f-947f-6c25f55df3f8") : secret "metrics-daemon-secret" not found Jun 06 20:22:16.815027 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:16.814972 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7crdx" podUID="cf504e7d-2b68-4404-96cb-3148b414abfb" Jun 06 20:22:16.969278 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:16.969246 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7crdx" Jun 06 20:22:17.376053 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:17.376013 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sgvqq" podUID="45defa4b-0edc-4a3f-947f-6c25f55df3f8" Jun 06 20:22:21.726160 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:21.726015 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:22:21.726505 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:21.726179 2537 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 20:22:21.726505 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:21.726284 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls podName:cf504e7d-2b68-4404-96cb-3148b414abfb nodeName:}" failed. No retries permitted until 2026-06-06 20:24:23.726264737 +0000 UTC m=+284.802689871 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls") pod "dns-default-7crdx" (UID: "cf504e7d-2b68-4404-96cb-3148b414abfb") : secret "dns-default-metrics-tls" not found Jun 06 20:22:29.353536 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:29.353499 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:22:40.636481 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.636440 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n"] Jun 06 20:22:40.638327 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.638308 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg"] Jun 06 20:22:40.638454 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.638436 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" Jun 06 20:22:40.640033 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.640014 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-pvglm"] Jun 06 20:22:40.640171 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.640154 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.641389 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.641369 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.641560 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.641543 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.641786 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.641726 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9bcxr\"" Jun 06 20:22:40.641786 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.641739 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.642369 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.642352 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 06 20:22:40.642438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.642370 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 06 20:22:40.642804 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.642789 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gpncn\"" Jun 06 20:22:40.642967 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.642952 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.643005 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.642959 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.643781 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.643764 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q5nhx\"" Jun 06 20:22:40.643929 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.643914 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 06 20:22:40.644504 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.644486 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.645139 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.645100 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 06 20:22:40.645247 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.645151 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.649992 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.649965 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 06 20:22:40.651230 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.651209 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg"] Jun 06 20:22:40.656307 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.656287 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n"] Jun 06 20:22:40.671500 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.671476 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pvglm"] Jun 06 20:22:40.735333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.735298 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75c897769c-tszxg"] Jun 06 20:22:40.737176 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.737155 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.739510 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.739491 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 20:22:40.739629 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.739606 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 06 20:22:40.739817 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.739804 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 06 20:22:40.739911 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.739892 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 06 20:22:40.739960 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.739902 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rwbvc\"" Jun 06 20:22:40.740009 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.739902 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 20:22:40.740359 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.740342 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 06 20:22:40.751768 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.751749 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75c897769c-tszxg"] Jun 06 20:22:40.757240 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757222 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f212a0cb-affc-4d5a-8e12-e3789cceac8d-config\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.757354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757248 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39d1df18-2baf-46e9-a234-9c129f9b35f7-snapshots\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.757354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757278 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d1df18-2baf-46e9-a234-9c129f9b35f7-service-ca-bundle\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.757354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757308 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgpl5\" (UniqueName: \"kubernetes.io/projected/f212a0cb-affc-4d5a-8e12-e3789cceac8d-kube-api-access-vgpl5\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.757354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757326 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k8r4\" (UniqueName: \"kubernetes.io/projected/6357fb1d-8800-494c-98d6-057a4652fbb2-kube-api-access-8k8r4\") pod \"volume-data-source-validator-78dd696465-l6n7n\" (UID: \"6357fb1d-8800-494c-98d6-057a4652fbb2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" Jun 06 20:22:40.757354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757342 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39d1df18-2baf-46e9-a234-9c129f9b35f7-serving-cert\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.757354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757356 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g72d5\" (UniqueName: \"kubernetes.io/projected/39d1df18-2baf-46e9-a234-9c129f9b35f7-kube-api-access-g72d5\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.757598 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757375 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39d1df18-2baf-46e9-a234-9c129f9b35f7-tmp\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.757598 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757409 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d1df18-2baf-46e9-a234-9c129f9b35f7-trusted-ca-bundle\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.757598 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.757473 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f212a0cb-affc-4d5a-8e12-e3789cceac8d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.828460 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.828430 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7454fdb49b-ngfnx"] Jun 06 20:22:40.830219 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.830198 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.832912 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.832885 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rp5vr\"" Jun 06 20:22:40.832912 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.832887 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 20:22:40.833067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.832916 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 20:22:40.833067 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.833019 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 20:22:40.839441 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.839422 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 20:22:40.847049 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.847025 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7454fdb49b-ngfnx"] Jun 06 20:22:40.858146 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858122 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f212a0cb-affc-4d5a-8e12-e3789cceac8d-config\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.858234 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858161 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39d1df18-2baf-46e9-a234-9c129f9b35f7-snapshots\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.858234 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858199 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d1df18-2baf-46e9-a234-9c129f9b35f7-service-ca-bundle\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.858347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858238 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgpl5\" (UniqueName: \"kubernetes.io/projected/f212a0cb-affc-4d5a-8e12-e3789cceac8d-kube-api-access-vgpl5\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.858347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858272 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k8r4\" (UniqueName: \"kubernetes.io/projected/6357fb1d-8800-494c-98d6-057a4652fbb2-kube-api-access-8k8r4\") pod \"volume-data-source-validator-78dd696465-l6n7n\" (UID: \"6357fb1d-8800-494c-98d6-057a4652fbb2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" Jun 06 20:22:40.858347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858294 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39d1df18-2baf-46e9-a234-9c129f9b35f7-serving-cert\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.858347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858320 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g72d5\" (UniqueName: \"kubernetes.io/projected/39d1df18-2baf-46e9-a234-9c129f9b35f7-kube-api-access-g72d5\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.858538 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858349 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39d1df18-2baf-46e9-a234-9c129f9b35f7-tmp\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.858538 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858376 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-default-certificate\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.858538 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858400 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d1df18-2baf-46e9-a234-9c129f9b35f7-trusted-ca-bundle\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.858538 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858420 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-stats-auth\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.858538 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858444 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f212a0cb-affc-4d5a-8e12-e3789cceac8d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.858843 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858467 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.858843 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858609 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4s5s\" (UniqueName: \"kubernetes.io/projected/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-kube-api-access-k4s5s\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.858843 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858624 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f212a0cb-affc-4d5a-8e12-e3789cceac8d-config\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.858843 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858640 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.859048 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858880 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d1df18-2baf-46e9-a234-9c129f9b35f7-service-ca-bundle\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.859048 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858975 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39d1df18-2baf-46e9-a234-9c129f9b35f7-snapshots\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.859048 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.858984 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39d1df18-2baf-46e9-a234-9c129f9b35f7-tmp\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.859357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.859341 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39d1df18-2baf-46e9-a234-9c129f9b35f7-trusted-ca-bundle\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.860754 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.860734 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f212a0cb-affc-4d5a-8e12-e3789cceac8d-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.860831 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.860783 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39d1df18-2baf-46e9-a234-9c129f9b35f7-serving-cert\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.869103 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.869078 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k8r4\" (UniqueName: \"kubernetes.io/projected/6357fb1d-8800-494c-98d6-057a4652fbb2-kube-api-access-8k8r4\") pod \"volume-data-source-validator-78dd696465-l6n7n\" (UID: \"6357fb1d-8800-494c-98d6-057a4652fbb2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" Jun 06 20:22:40.869205 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.869168 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g72d5\" (UniqueName: \"kubernetes.io/projected/39d1df18-2baf-46e9-a234-9c129f9b35f7-kube-api-access-g72d5\") pod \"insights-operator-896549976-pvglm\" (UID: \"39d1df18-2baf-46e9-a234-9c129f9b35f7\") " pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.869821 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.869804 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgpl5\" (UniqueName: \"kubernetes.io/projected/f212a0cb-affc-4d5a-8e12-e3789cceac8d-kube-api-access-vgpl5\") pod \"service-ca-operator-6bc5ff68f5-ct7wg\" (UID: \"f212a0cb-affc-4d5a-8e12-e3789cceac8d\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.948799 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.948704 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" Jun 06 20:22:40.958355 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.958329 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" Jun 06 20:22:40.959684 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.959651 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-certificates\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.959800 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.959697 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda5a7a5-9553-498c-9249-bd64e367ee97-ca-trust-extracted\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.959800 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.959734 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.959910 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.959797 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-default-certificate\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.959910 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.959836 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4s5s\" (UniqueName: \"kubernetes.io/projected/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-kube-api-access-k4s5s\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.959910 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.959869 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-stats-auth\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.961425 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:40.959840 2537 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 20:22:40.961425 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.960169 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.961425 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.960370 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf467\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-kube-api-access-pf467\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.961425 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:40.960943 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:41.460906132 +0000 UTC m=+182.537331261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : secret "router-metrics-certs-default" not found Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.960557 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-bound-sa-token\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.961535 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:40.961768 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:41.461612551 +0000 UTC m=+182.538037691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : configmap references non-existent config key: service-ca.crt Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.961847 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-installation-pull-secrets\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.962177 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-trusted-ca\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.962226 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-image-registry-private-configuration\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.963465 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-default-certificate\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.963602 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-pvglm" Jun 06 20:22:40.966001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.964422 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-stats-auth\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:40.971406 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:40.971381 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4s5s\" (UniqueName: \"kubernetes.io/projected/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-kube-api-access-k4s5s\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:41.063846 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.063806 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf467\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-kube-api-access-pf467\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.063980 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.063860 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-bound-sa-token\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.063980 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.063896 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.063980 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.063933 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-installation-pull-secrets\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.064173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.063995 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-trusted-ca\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.064173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.064023 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-image-registry-private-configuration\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.064173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.064056 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-certificates\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.064173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.064081 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda5a7a5-9553-498c-9249-bd64e367ee97-ca-trust-extracted\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.065317 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.064584 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda5a7a5-9553-498c-9249-bd64e367ee97-ca-trust-extracted\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.065317 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.065239 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-certificates\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.066042 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.065334 2537 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:22:41.066042 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.065349 2537 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454fdb49b-ngfnx: secret "image-registry-tls" not found Jun 06 20:22:41.066042 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.065400 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls podName:bda5a7a5-9553-498c-9249-bd64e367ee97 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:41.565382819 +0000 UTC m=+182.641807949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls") pod "image-registry-7454fdb49b-ngfnx" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97") : secret "image-registry-tls" not found Jun 06 20:22:41.067494 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.067466 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-trusted-ca\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.067720 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.067687 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-installation-pull-secrets\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.067800 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.067685 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-image-registry-private-configuration\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.074185 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.074131 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-bound-sa-token\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.074298 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.074267 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf467\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-kube-api-access-pf467\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.093003 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.092967 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n"] Jun 06 20:22:41.096373 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:22:41.096347 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6357fb1d_8800_494c_98d6_057a4652fbb2.slice/crio-324f43a05b165fbcfaadc45ef467b63a2d0702ded029d13f8fe13f19c16ce48a WatchSource:0}: Error finding container 324f43a05b165fbcfaadc45ef467b63a2d0702ded029d13f8fe13f19c16ce48a: Status 404 returned error can't find the container with id 324f43a05b165fbcfaadc45ef467b63a2d0702ded029d13f8fe13f19c16ce48a Jun 06 20:22:41.113687 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.113663 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-pvglm"] Jun 06 20:22:41.116330 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:22:41.116302 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d1df18_2baf_46e9_a234_9c129f9b35f7.slice/crio-f524ded9c2c2f32c00ed6763260ac77a62a2e1cca367f08bdbd20fb6f3659328 WatchSource:0}: Error finding container f524ded9c2c2f32c00ed6763260ac77a62a2e1cca367f08bdbd20fb6f3659328: Status 404 returned error can't find the container with id f524ded9c2c2f32c00ed6763260ac77a62a2e1cca367f08bdbd20fb6f3659328 Jun 06 20:22:41.319401 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.319369 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg"] Jun 06 20:22:41.322223 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:22:41.322188 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf212a0cb_affc_4d5a_8e12_e3789cceac8d.slice/crio-f8f1617f71c44e1402f91c59adcf60a3969646434ba1c82d4a45b821c42dfadd WatchSource:0}: Error finding container f8f1617f71c44e1402f91c59adcf60a3969646434ba1c82d4a45b821c42dfadd: Status 404 returned error can't find the container with id f8f1617f71c44e1402f91c59adcf60a3969646434ba1c82d4a45b821c42dfadd Jun 06 20:22:41.467768 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.467728 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:41.467956 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.467784 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:41.467956 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.467866 2537 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 20:22:41.467956 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.467931 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:42.467915913 +0000 UTC m=+183.544341030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : secret "router-metrics-certs-default" not found Jun 06 20:22:41.468091 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.467959 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:42.467941203 +0000 UTC m=+183.544366332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : configmap references non-existent config key: service-ca.crt Jun 06 20:22:41.568290 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:41.568255 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:41.568488 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.568425 2537 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:22:41.568488 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.568448 2537 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454fdb49b-ngfnx: secret "image-registry-tls" not found Jun 06 20:22:41.568601 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:41.568501 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls podName:bda5a7a5-9553-498c-9249-bd64e367ee97 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:42.568486721 +0000 UTC m=+183.644911841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls") pod "image-registry-7454fdb49b-ngfnx" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97") : secret "image-registry-tls" not found Jun 06 20:22:42.033779 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:42.033732 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" event={"ID":"6357fb1d-8800-494c-98d6-057a4652fbb2","Type":"ContainerStarted","Data":"324f43a05b165fbcfaadc45ef467b63a2d0702ded029d13f8fe13f19c16ce48a"} Jun 06 20:22:42.035345 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:42.035315 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pvglm" event={"ID":"39d1df18-2baf-46e9-a234-9c129f9b35f7","Type":"ContainerStarted","Data":"f524ded9c2c2f32c00ed6763260ac77a62a2e1cca367f08bdbd20fb6f3659328"} Jun 06 20:22:42.036962 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:42.036898 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" event={"ID":"f212a0cb-affc-4d5a-8e12-e3789cceac8d","Type":"ContainerStarted","Data":"f8f1617f71c44e1402f91c59adcf60a3969646434ba1c82d4a45b821c42dfadd"} Jun 06 20:22:42.475162 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:42.475119 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:42.475368 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:42.475263 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:42.475368 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:42.475282 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:44.475257137 +0000 UTC m=+185.551682267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : configmap references non-existent config key: service-ca.crt Jun 06 20:22:42.475368 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:42.475363 2537 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 20:22:42.475664 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:42.475431 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:44.475413194 +0000 UTC m=+185.551838313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : secret "router-metrics-certs-default" not found Jun 06 20:22:42.576678 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:42.576592 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:42.576816 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:42.576746 2537 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:22:42.576816 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:42.576766 2537 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454fdb49b-ngfnx: secret "image-registry-tls" not found Jun 06 20:22:42.576896 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:42.576821 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls podName:bda5a7a5-9553-498c-9249-bd64e367ee97 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:44.576805346 +0000 UTC m=+185.653230467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls") pod "image-registry-7454fdb49b-ngfnx" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97") : secret "image-registry-tls" not found Jun 06 20:22:43.041794 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:43.041752 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" event={"ID":"6357fb1d-8800-494c-98d6-057a4652fbb2","Type":"ContainerStarted","Data":"de72bc9efb7496b20455cebde70a1c58c6303efdfc065ba128578a082bba0b0e"} Jun 06 20:22:43.057386 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:43.057335 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-l6n7n" podStartSLOduration=1.8495355 podStartE2EDuration="3.057318311s" totalImagesPullingTime="1.207782811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:43.056637092 +0000 UTC m=+184.133062231" watchObservedRunningTime="2026-06-06 20:22:43.057318311 +0000 UTC m=+184.133743449" Jun 06 20:22:44.047718 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.047680 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" event={"ID":"f212a0cb-affc-4d5a-8e12-e3789cceac8d","Type":"ContainerStarted","Data":"ec19cf6269acaabfdc0e960dedc831684ac3d1a6d6bde0717d5f0e5547620f38"} Jun 06 20:22:44.049232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.049206 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pvglm" event={"ID":"39d1df18-2baf-46e9-a234-9c129f9b35f7","Type":"ContainerStarted","Data":"8c57ab2a4a993727f08e5fbe1e68ad62ae30b35dd83d66dea3ddc553f253429d"} Jun 06 20:22:44.064215 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.064127 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" podStartSLOduration=1.584274245 podStartE2EDuration="4.064092771s" totalImagesPullingTime="2.479818526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:44.063405363 +0000 UTC m=+185.139830504" watchObservedRunningTime="2026-06-06 20:22:44.064092771 +0000 UTC m=+185.140517912" Jun 06 20:22:44.080877 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.080831 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-pvglm" podStartSLOduration=1.396861936 podStartE2EDuration="4.080814879s" totalImagesPullingTime="2.683952943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:44.079888508 +0000 UTC m=+185.156313649" watchObservedRunningTime="2026-06-06 20:22:44.080814879 +0000 UTC m=+185.157240044" Jun 06 20:22:44.491982 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.491952 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:44.492182 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.492047 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:44.492182 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:44.492135 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:48.492117225 +0000 UTC m=+189.568542356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : configmap references non-existent config key: service-ca.crt Jun 06 20:22:44.492182 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:44.492156 2537 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 20:22:44.492345 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:44.492211 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:48.492197403 +0000 UTC m=+189.568622523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : secret "router-metrics-certs-default" not found Jun 06 20:22:44.592802 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.592755 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:44.592994 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:44.592887 2537 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:22:44.592994 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:44.592904 2537 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454fdb49b-ngfnx: secret "image-registry-tls" not found Jun 06 20:22:44.592994 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:44.592967 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls podName:bda5a7a5-9553-498c-9249-bd64e367ee97 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:48.59294964 +0000 UTC m=+189.669374774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls") pod "image-registry-7454fdb49b-ngfnx" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97") : secret "image-registry-tls" not found Jun 06 20:22:44.995841 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.995808 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw"] Jun 06 20:22:44.997689 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:44.997672 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" Jun 06 20:22:45.000407 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.000385 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 06 20:22:45.001495 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.001465 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qngnf\"" Jun 06 20:22:45.001610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.001516 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 06 20:22:45.013257 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.013233 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw"] Jun 06 20:22:45.095482 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.095442 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvdwc\" (UniqueName: \"kubernetes.io/projected/577212de-59f8-4ce9-a529-c8e4535eb4c9-kube-api-access-xvdwc\") pod \"migrator-955ffdf5f-tmkdw\" (UID: \"577212de-59f8-4ce9-a529-c8e4535eb4c9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" Jun 06 20:22:45.196016 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.195977 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvdwc\" (UniqueName: \"kubernetes.io/projected/577212de-59f8-4ce9-a529-c8e4535eb4c9-kube-api-access-xvdwc\") pod \"migrator-955ffdf5f-tmkdw\" (UID: \"577212de-59f8-4ce9-a529-c8e4535eb4c9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" Jun 06 20:22:45.203874 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.203839 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvdwc\" (UniqueName: \"kubernetes.io/projected/577212de-59f8-4ce9-a529-c8e4535eb4c9-kube-api-access-xvdwc\") pod \"migrator-955ffdf5f-tmkdw\" (UID: \"577212de-59f8-4ce9-a529-c8e4535eb4c9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" Jun 06 20:22:45.307482 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.307384 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" Jun 06 20:22:45.428639 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:45.428571 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw"] Jun 06 20:22:45.432210 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:22:45.432181 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577212de_59f8_4ce9_a529_c8e4535eb4c9.slice/crio-540d6bced2ac3fdb0f71463138accb8f1d1d8620ab79684744bbbd35c9840c4d WatchSource:0}: Error finding container 540d6bced2ac3fdb0f71463138accb8f1d1d8620ab79684744bbbd35c9840c4d: Status 404 returned error can't find the container with id 540d6bced2ac3fdb0f71463138accb8f1d1d8620ab79684744bbbd35c9840c4d Jun 06 20:22:46.059231 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:46.059192 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" event={"ID":"577212de-59f8-4ce9-a529-c8e4535eb4c9","Type":"ContainerStarted","Data":"540d6bced2ac3fdb0f71463138accb8f1d1d8620ab79684744bbbd35c9840c4d"} Jun 06 20:22:47.064244 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:47.064209 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" event={"ID":"577212de-59f8-4ce9-a529-c8e4535eb4c9","Type":"ContainerStarted","Data":"985c9e760b87eb7d376d0ec6cdfa0cfabdb138e1418b950ef243feaf2b64169d"} Jun 06 20:22:47.064721 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:47.064269 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" event={"ID":"577212de-59f8-4ce9-a529-c8e4535eb4c9","Type":"ContainerStarted","Data":"75ae53df312f98f0f43a5898e634de4f73c7f4ce89221dff108cf15791e130f7"} Jun 06 20:22:47.080033 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:47.079983 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-tmkdw" podStartSLOduration=1.937989286 podStartE2EDuration="3.079967339s" totalImagesPullingTime="1.141978053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:47.07933801 +0000 UTC m=+188.155763150" watchObservedRunningTime="2026-06-06 20:22:47.079967339 +0000 UTC m=+188.156392500" Jun 06 20:22:47.863010 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:47.862985 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dpkw_73187db6-5446-4b72-a0b3-ff3be6af2eb8/dns-node-resolver/0.log" Jun 06 20:22:48.519761 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:48.519725 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:48.520159 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:48.519779 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:48.520159 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:48.519883 2537 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 20:22:48.520159 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:48.519929 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:56.519913017 +0000 UTC m=+197.596338138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : secret "router-metrics-certs-default" not found Jun 06 20:22:48.520159 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:48.519947 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:22:56.51993724 +0000 UTC m=+197.596362359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : configmap references non-existent config key: service-ca.crt Jun 06 20:22:48.620628 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:48.620587 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:48.620805 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:48.620737 2537 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 20:22:48.620805 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:48.620755 2537 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7454fdb49b-ngfnx: secret "image-registry-tls" not found Jun 06 20:22:48.620875 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:48.620808 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls podName:bda5a7a5-9553-498c-9249-bd64e367ee97 nodeName:}" failed. No retries permitted until 2026-06-06 20:22:56.620792371 +0000 UTC m=+197.697217492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls") pod "image-registry-7454fdb49b-ngfnx" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97") : secret "image-registry-tls" not found Jun 06 20:22:48.863201 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:48.863122 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6x4q_f298a496-2968-4d0d-8026-0e39b5759b44/node-ca/0.log" Jun 06 20:22:49.663580 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:49.663552 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktlcq_d9fa04f6-dea5-4f93-bc17-bd260da5d3ed/serve-healthcheck-canary/0.log" Jun 06 20:22:50.063126 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:50.063087 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-tmkdw_577212de-59f8-4ce9-a529-c8e4535eb4c9/migrator/0.log" Jun 06 20:22:50.262951 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:50.262924 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-tmkdw_577212de-59f8-4ce9-a529-c8e4535eb4c9/graceful-termination/0.log" Jun 06 20:22:56.583476 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:56.583435 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:56.583927 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:56.583489 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:22:56.583927 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:56.583608 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:23:12.583593431 +0000 UTC m=+213.660018548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : configmap references non-existent config key: service-ca.crt Jun 06 20:22:56.583927 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:56.583612 2537 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 06 20:22:56.583927 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:22:56.583703 2537 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs podName:8da29d36-fca5-4625-8ce6-ef7fdfb7cfec nodeName:}" failed. No retries permitted until 2026-06-06 20:23:12.583684716 +0000 UTC m=+213.660109849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs") pod "router-default-75c897769c-tszxg" (UID: "8da29d36-fca5-4625-8ce6-ef7fdfb7cfec") : secret "router-metrics-certs-default" not found Jun 06 20:22:56.685141 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:56.685086 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:56.687476 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:56.687447 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"image-registry-7454fdb49b-ngfnx\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:56.741165 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:56.741129 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:22:56.871884 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:56.871805 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7454fdb49b-ngfnx"] Jun 06 20:22:56.875177 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:22:56.875147 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda5a7a5_9553_498c_9249_bd64e367ee97.slice/crio-f35619a3bd98f9ec98c5acd7dd7eab4e561964ea908cd447d3678d5f593f6c1d WatchSource:0}: Error finding container f35619a3bd98f9ec98c5acd7dd7eab4e561964ea908cd447d3678d5f593f6c1d: Status 404 returned error can't find the container with id f35619a3bd98f9ec98c5acd7dd7eab4e561964ea908cd447d3678d5f593f6c1d Jun 06 20:22:57.098642 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:57.098609 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" event={"ID":"bda5a7a5-9553-498c-9249-bd64e367ee97","Type":"ContainerStarted","Data":"cd809718f2bb6e0ea731c28439daf8e7aaff3c2c32a79f612495b3b0a3728ba2"} Jun 06 20:22:57.098803 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:57.098658 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" event={"ID":"bda5a7a5-9553-498c-9249-bd64e367ee97","Type":"ContainerStarted","Data":"f35619a3bd98f9ec98c5acd7dd7eab4e561964ea908cd447d3678d5f593f6c1d"} Jun 06 20:22:57.098803 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:22:57.098753 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:23:08.714149 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.714078 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" podStartSLOduration=28.71406205 podStartE2EDuration="28.71406205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:22:57.116562297 +0000 UTC m=+198.192987439" watchObservedRunningTime="2026-06-06 20:23:08.71406205 +0000 UTC m=+209.790487188" Jun 06 20:23:08.714545 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.714461 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7xv2x"] Jun 06 20:23:08.719452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.719423 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.723167 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.723145 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bf6nr\"" Jun 06 20:23:08.723167 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.723157 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 20:23:08.723379 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.723150 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 20:23:08.729071 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.729047 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7xv2x"] Jun 06 20:23:08.742620 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.742593 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7454fdb49b-ngfnx"] Jun 06 20:23:08.779167 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.779102 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/978e2523-6ab4-47b7-8b5f-a4ec6586d825-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.779367 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.779185 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvdsz\" (UniqueName: \"kubernetes.io/projected/978e2523-6ab4-47b7-8b5f-a4ec6586d825-kube-api-access-zvdsz\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.779367 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.779269 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/978e2523-6ab4-47b7-8b5f-a4ec6586d825-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.779367 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.779300 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/978e2523-6ab4-47b7-8b5f-a4ec6586d825-crio-socket\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.779489 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.779401 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/978e2523-6ab4-47b7-8b5f-a4ec6586d825-data-volume\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880273 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880232 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/978e2523-6ab4-47b7-8b5f-a4ec6586d825-crio-socket\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880454 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880358 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/978e2523-6ab4-47b7-8b5f-a4ec6586d825-crio-socket\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880454 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880371 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/978e2523-6ab4-47b7-8b5f-a4ec6586d825-data-volume\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880454 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880392 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/978e2523-6ab4-47b7-8b5f-a4ec6586d825-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880454 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880415 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvdsz\" (UniqueName: \"kubernetes.io/projected/978e2523-6ab4-47b7-8b5f-a4ec6586d825-kube-api-access-zvdsz\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880667 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880565 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/978e2523-6ab4-47b7-8b5f-a4ec6586d825-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.880735 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.880664 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/978e2523-6ab4-47b7-8b5f-a4ec6586d825-data-volume\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.881083 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.881063 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/978e2523-6ab4-47b7-8b5f-a4ec6586d825-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.882743 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.882723 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/978e2523-6ab4-47b7-8b5f-a4ec6586d825-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:08.890006 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:08.889983 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvdsz\" (UniqueName: \"kubernetes.io/projected/978e2523-6ab4-47b7-8b5f-a4ec6586d825-kube-api-access-zvdsz\") pod \"insights-runtime-extractor-7xv2x\" (UID: \"978e2523-6ab4-47b7-8b5f-a4ec6586d825\") " pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:09.028126 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:09.028078 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7xv2x" Jun 06 20:23:09.153799 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:09.153764 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7xv2x"] Jun 06 20:23:09.156876 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:09.156816 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978e2523_6ab4_47b7_8b5f_a4ec6586d825.slice/crio-7436d08152a4771812e74f616a7768337e83f5425aa3b98737aa6f999388ba98 WatchSource:0}: Error finding container 7436d08152a4771812e74f616a7768337e83f5425aa3b98737aa6f999388ba98: Status 404 returned error can't find the container with id 7436d08152a4771812e74f616a7768337e83f5425aa3b98737aa6f999388ba98 Jun 06 20:23:10.139969 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:10.139886 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xv2x" event={"ID":"978e2523-6ab4-47b7-8b5f-a4ec6586d825","Type":"ContainerStarted","Data":"0a48983be4690cb84a64279b8a5ab7fba0f7ccfe4258f3bcc3520d6950667426"} Jun 06 20:23:10.139969 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:10.139942 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xv2x" event={"ID":"978e2523-6ab4-47b7-8b5f-a4ec6586d825","Type":"ContainerStarted","Data":"ce0133dc746f80c6ec9158b95e1dd90be4011ba3406747298a1d59de4926cc04"} Jun 06 20:23:10.139969 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:10.139960 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xv2x" event={"ID":"978e2523-6ab4-47b7-8b5f-a4ec6586d825","Type":"ContainerStarted","Data":"7436d08152a4771812e74f616a7768337e83f5425aa3b98737aa6f999388ba98"} Jun 06 20:23:12.149073 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.149033 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xv2x" event={"ID":"978e2523-6ab4-47b7-8b5f-a4ec6586d825","Type":"ContainerStarted","Data":"7784894d30eaa8d48402c056b0c8484230834517b953e5494b847249d60900eb"} Jun 06 20:23:12.169129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.169060 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7xv2x" podStartSLOduration=2.120309527 podStartE2EDuration="4.169042962s" totalImagesPullingTime="2.048733435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 20:23:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:12.168620853 +0000 UTC m=+213.245045995" watchObservedRunningTime="2026-06-06 20:23:12.169042962 +0000 UTC m=+213.245468101" Jun 06 20:23:12.612449 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.612212 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:12.612694 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.612671 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:12.613521 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.613491 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-service-ca-bundle\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:12.616384 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.615425 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8da29d36-fca5-4625-8ce6-ef7fdfb7cfec-metrics-certs\") pod \"router-default-75c897769c-tszxg\" (UID: \"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec\") " pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:12.846360 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.846313 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:12.975930 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:12.975894 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75c897769c-tszxg"] Jun 06 20:23:12.979170 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:12.979137 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da29d36_fca5_4625_8ce6_ef7fdfb7cfec.slice/crio-30d47f207b53a7cbfeed738fc9d974e9819af1447621313f2047b282b987b274 WatchSource:0}: Error finding container 30d47f207b53a7cbfeed738fc9d974e9819af1447621313f2047b282b987b274: Status 404 returned error can't find the container with id 30d47f207b53a7cbfeed738fc9d974e9819af1447621313f2047b282b987b274 Jun 06 20:23:13.154266 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:13.154160 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75c897769c-tszxg" event={"ID":"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec","Type":"ContainerStarted","Data":"5079c646df4f87eb6fba31006e4df4c8db6a09e4298f728bf8160bb70ea4e17b"} Jun 06 20:23:13.154266 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:13.154217 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75c897769c-tszxg" event={"ID":"8da29d36-fca5-4625-8ce6-ef7fdfb7cfec","Type":"ContainerStarted","Data":"30d47f207b53a7cbfeed738fc9d974e9819af1447621313f2047b282b987b274"} Jun 06 20:23:13.172370 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:13.172285 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75c897769c-tszxg" podStartSLOduration=33.172271022 podStartE2EDuration="33.172271022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:13.171090293 +0000 UTC m=+214.247515432" watchObservedRunningTime="2026-06-06 20:23:13.172271022 +0000 UTC m=+214.248696161" Jun 06 20:23:13.847392 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:13.847356 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:13.849805 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:13.849779 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:14.157222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:14.157143 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:14.158447 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:14.158424 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75c897769c-tszxg" Jun 06 20:23:18.569872 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.569837 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wkn82"] Jun 06 20:23:18.572447 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.572431 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.574994 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.574967 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 06 20:23:18.576314 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.576295 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 20:23:18.576314 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.576310 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 20:23:18.576485 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.576325 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 06 20:23:18.576485 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.576341 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qz6dq\"" Jun 06 20:23:18.576485 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.576443 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 20:23:18.582746 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.582724 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wkn82"] Jun 06 20:23:18.660324 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.660247 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41cdd166-fb00-47c5-bba0-edb7ce9859a2-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.660324 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.660296 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41cdd166-fb00-47c5-bba0-edb7ce9859a2-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.660502 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.660359 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41cdd166-fb00-47c5-bba0-edb7ce9859a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.660502 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.660401 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5prb\" (UniqueName: \"kubernetes.io/projected/41cdd166-fb00-47c5-bba0-edb7ce9859a2-kube-api-access-p5prb\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.748322 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.748285 2537 patch_prober.go:28] interesting pod/image-registry-7454fdb49b-ngfnx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:18.748567 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.748339 2537 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:18.761347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.761318 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41cdd166-fb00-47c5-bba0-edb7ce9859a2-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.761477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.761361 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41cdd166-fb00-47c5-bba0-edb7ce9859a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.761477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.761382 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5prb\" (UniqueName: \"kubernetes.io/projected/41cdd166-fb00-47c5-bba0-edb7ce9859a2-kube-api-access-p5prb\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.761477 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.761423 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41cdd166-fb00-47c5-bba0-edb7ce9859a2-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.762122 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.762090 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41cdd166-fb00-47c5-bba0-edb7ce9859a2-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.763705 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.763688 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41cdd166-fb00-47c5-bba0-edb7ce9859a2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.763886 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.763868 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/41cdd166-fb00-47c5-bba0-edb7ce9859a2-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.768544 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.768519 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5prb\" (UniqueName: \"kubernetes.io/projected/41cdd166-fb00-47c5-bba0-edb7ce9859a2-kube-api-access-p5prb\") pod \"prometheus-operator-7f7d445d84-wkn82\" (UID: \"41cdd166-fb00-47c5-bba0-edb7ce9859a2\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:18.881079 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:18.881046 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" Jun 06 20:23:19.006922 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:19.006802 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-wkn82"] Jun 06 20:23:19.009515 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:19.009486 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41cdd166_fb00_47c5_bba0_edb7ce9859a2.slice/crio-b15d65a51e05de3a124102a711a8f7d0a92c9da2846b769e90cd7fe3d2152e52 WatchSource:0}: Error finding container b15d65a51e05de3a124102a711a8f7d0a92c9da2846b769e90cd7fe3d2152e52: Status 404 returned error can't find the container with id b15d65a51e05de3a124102a711a8f7d0a92c9da2846b769e90cd7fe3d2152e52 Jun 06 20:23:19.173176 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:19.173139 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" event={"ID":"41cdd166-fb00-47c5-bba0-edb7ce9859a2","Type":"ContainerStarted","Data":"b15d65a51e05de3a124102a711a8f7d0a92c9da2846b769e90cd7fe3d2152e52"} Jun 06 20:23:21.181102 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:21.181061 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" event={"ID":"41cdd166-fb00-47c5-bba0-edb7ce9859a2","Type":"ContainerStarted","Data":"1416af8a35a066f96c09f35aebdf48e2b5462278a98e5cf628ff3d533ce96cc2"} Jun 06 20:23:21.181490 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:21.181147 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" event={"ID":"41cdd166-fb00-47c5-bba0-edb7ce9859a2","Type":"ContainerStarted","Data":"c8bd94e235f880820ccde06d414a322b3ae0d0177de6161d7449122395ac1f01"} Jun 06 20:23:21.197032 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:21.196981 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-wkn82" podStartSLOduration=1.9462258019999998 podStartE2EDuration="3.196966607s" totalImagesPullingTime="1.250740805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:21.195775487 +0000 UTC m=+222.272200617" watchObservedRunningTime="2026-06-06 20:23:21.196966607 +0000 UTC m=+222.273391745" Jun 06 20:23:22.951586 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:22.951549 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z85wm"] Jun 06 20:23:22.953822 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:22.953795 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:22.956179 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:22.956156 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 20:23:22.956305 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:22.956159 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7x6d4\"" Jun 06 20:23:22.956305 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:22.956159 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 20:23:22.956383 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:22.956325 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 20:23:23.097035 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.096993 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-accelerators-collector-config\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097224 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097051 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-textfile\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097224 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097131 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-sys\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097224 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097167 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-wtmp\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097224 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097193 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-root\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097238 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1749912d-7010-41c3-bb6c-5e5e59590efc-metrics-client-ca\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097269 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-tls\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097322 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjqv\" (UniqueName: \"kubernetes.io/projected/1749912d-7010-41c3-bb6c-5e5e59590efc-kube-api-access-sdjqv\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.097445 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.097357 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198500 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198467 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-sys\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198515 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-wtmp\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198535 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-root\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198553 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1749912d-7010-41c3-bb6c-5e5e59590efc-metrics-client-ca\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198576 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-tls\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198589 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-sys\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198615 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-root\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198621 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjqv\" (UniqueName: \"kubernetes.io/projected/1749912d-7010-41c3-bb6c-5e5e59590efc-kube-api-access-sdjqv\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198678 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-wtmp\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.198733 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198719 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.199075 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198765 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-accelerators-collector-config\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.199075 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.198799 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-textfile\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.199208 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.199145 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-textfile\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.199274 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.199254 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1749912d-7010-41c3-bb6c-5e5e59590efc-metrics-client-ca\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.199330 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.199309 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-accelerators-collector-config\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.201057 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.201032 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-tls\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.201204 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.201096 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1749912d-7010-41c3-bb6c-5e5e59590efc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.205978 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.205915 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjqv\" (UniqueName: \"kubernetes.io/projected/1749912d-7010-41c3-bb6c-5e5e59590efc-kube-api-access-sdjqv\") pod \"node-exporter-z85wm\" (UID: \"1749912d-7010-41c3-bb6c-5e5e59590efc\") " pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.263013 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:23.262975 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z85wm" Jun 06 20:23:23.272325 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:23.272294 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1749912d_7010_41c3_bb6c_5e5e59590efc.slice/crio-cd160e882f94f3e91ef4a037b8b13bd9a3987f17d7a16d2238cb3e3e7ea11a9e WatchSource:0}: Error finding container cd160e882f94f3e91ef4a037b8b13bd9a3987f17d7a16d2238cb3e3e7ea11a9e: Status 404 returned error can't find the container with id cd160e882f94f3e91ef4a037b8b13bd9a3987f17d7a16d2238cb3e3e7ea11a9e Jun 06 20:23:24.193248 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.193216 2537 generic.go:356] "Generic (PLEG): container finished" podID="1749912d-7010-41c3-bb6c-5e5e59590efc" containerID="1435bf9499909ec881d6b8e405376d654df2367b722195f3408d7ee160042240" exitCode=0 Jun 06 20:23:24.193602 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.193266 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z85wm" event={"ID":"1749912d-7010-41c3-bb6c-5e5e59590efc","Type":"ContainerDied","Data":"1435bf9499909ec881d6b8e405376d654df2367b722195f3408d7ee160042240"} Jun 06 20:23:24.193602 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.193311 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z85wm" event={"ID":"1749912d-7010-41c3-bb6c-5e5e59590efc","Type":"ContainerStarted","Data":"cd160e882f94f3e91ef4a037b8b13bd9a3987f17d7a16d2238cb3e3e7ea11a9e"} Jun 06 20:23:24.897094 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.897046 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-76d7854648-sldr8"] Jun 06 20:23:24.899953 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.899928 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:24.902610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.902589 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 06 20:23:24.902610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.902601 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nfcn4\"" Jun 06 20:23:24.902749 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.902599 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 06 20:23:24.902917 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.902901 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 06 20:23:24.902992 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.902959 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 06 20:23:24.903714 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.903698 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eloffub3tedbg\"" Jun 06 20:23:24.903714 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.903706 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 06 20:23:24.910675 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:24.910655 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76d7854648-sldr8"] Jun 06 20:23:25.011837 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.011806 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-grpc-tls\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.011998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.011844 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.011998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.011864 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd2ds\" (UniqueName: \"kubernetes.io/projected/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-kube-api-access-bd2ds\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.011998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.011912 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.011998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.011960 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-metrics-client-ca\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.011998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.011981 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.012190 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.012004 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-tls\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.012190 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.012031 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113291 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113246 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113307 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-metrics-client-ca\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113332 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113358 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-tls\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113388 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113411 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-grpc-tls\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113440 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.113470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.113466 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd2ds\" (UniqueName: \"kubernetes.io/projected/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-kube-api-access-bd2ds\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.114299 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.114269 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-metrics-client-ca\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.116206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.116182 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-tls\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.116328 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.116172 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-grpc-tls\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.116328 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.116301 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.116465 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.116439 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.116529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.116459 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.116529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.116457 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.121824 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.121799 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd2ds\" (UniqueName: \"kubernetes.io/projected/6faa1e6b-9a1b-4840-9391-eba508d9e9e7-kube-api-access-bd2ds\") pod \"thanos-querier-76d7854648-sldr8\" (UID: \"6faa1e6b-9a1b-4840-9391-eba508d9e9e7\") " pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.198680 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.198586 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z85wm" event={"ID":"1749912d-7010-41c3-bb6c-5e5e59590efc","Type":"ContainerStarted","Data":"c1c69292631d7fc4abb2648a231cf9cb27296e7550ec5c26df26dbb768ad08ce"} Jun 06 20:23:25.198680 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.198642 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z85wm" event={"ID":"1749912d-7010-41c3-bb6c-5e5e59590efc","Type":"ContainerStarted","Data":"461eebf513b1c2d797964a2f661eb0ee0cb12506474f783ac1d78cd059cb17e8"} Jun 06 20:23:25.209514 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.209493 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:25.216719 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.216671 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z85wm" podStartSLOduration=2.37696252 podStartE2EDuration="3.216655109s" totalImagesPullingTime="774.243992ms" totalInitContainerRuntime="65.448597ms" isStatefulPod=true podCreationTimestamp="2026-06-06 20:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:25.216210992 +0000 UTC m=+226.292636131" watchObservedRunningTime="2026-06-06 20:23:25.216655109 +0000 UTC m=+226.293080295" Jun 06 20:23:25.335673 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:25.335643 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-76d7854648-sldr8"] Jun 06 20:23:25.339491 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:25.339461 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6faa1e6b_9a1b_4840_9391_eba508d9e9e7.slice/crio-ea4d02a1b2145f729cbb8de514e8d9f48a7b62069b819ff710b9b1b19a0562d7 WatchSource:0}: Error finding container ea4d02a1b2145f729cbb8de514e8d9f48a7b62069b819ff710b9b1b19a0562d7: Status 404 returned error can't find the container with id ea4d02a1b2145f729cbb8de514e8d9f48a7b62069b819ff710b9b1b19a0562d7 Jun 06 20:23:26.207171 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:26.207133 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"ea4d02a1b2145f729cbb8de514e8d9f48a7b62069b819ff710b9b1b19a0562d7"} Jun 06 20:23:27.686262 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.686179 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-75vqp"] Jun 06 20:23:27.689503 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.689475 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.692079 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.692057 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 06 20:23:27.692225 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.692099 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-g4b94\"" Jun 06 20:23:27.695820 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.695797 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-75vqp"] Jun 06 20:23:27.836535 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.836494 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbf2b\" (UniqueName: \"kubernetes.io/projected/2c037ed1-5959-4514-b26a-04d5df3dbd42-kube-api-access-hbf2b\") pod \"monitoring-plugin-76b68cc874-75vqp\" (UID: \"2c037ed1-5959-4514-b26a-04d5df3dbd42\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.836710 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.836573 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c037ed1-5959-4514-b26a-04d5df3dbd42-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-75vqp\" (UID: \"2c037ed1-5959-4514-b26a-04d5df3dbd42\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.937923 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.937842 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbf2b\" (UniqueName: \"kubernetes.io/projected/2c037ed1-5959-4514-b26a-04d5df3dbd42-kube-api-access-hbf2b\") pod \"monitoring-plugin-76b68cc874-75vqp\" (UID: \"2c037ed1-5959-4514-b26a-04d5df3dbd42\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.938075 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.937928 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c037ed1-5959-4514-b26a-04d5df3dbd42-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-75vqp\" (UID: \"2c037ed1-5959-4514-b26a-04d5df3dbd42\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.940635 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.940603 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2c037ed1-5959-4514-b26a-04d5df3dbd42-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-75vqp\" (UID: \"2c037ed1-5959-4514-b26a-04d5df3dbd42\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.945903 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.945875 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbf2b\" (UniqueName: \"kubernetes.io/projected/2c037ed1-5959-4514-b26a-04d5df3dbd42-kube-api-access-hbf2b\") pod \"monitoring-plugin-76b68cc874-75vqp\" (UID: \"2c037ed1-5959-4514-b26a-04d5df3dbd42\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:27.999718 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:27.999683 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:28.134088 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.134055 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-75vqp"] Jun 06 20:23:28.173719 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:28.173677 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c037ed1_5959_4514_b26a_04d5df3dbd42.slice/crio-cd6f77eaa63a9290251ffce5a060f15abc4ca64f77b38e1072557779a81f9712 WatchSource:0}: Error finding container cd6f77eaa63a9290251ffce5a060f15abc4ca64f77b38e1072557779a81f9712: Status 404 returned error can't find the container with id cd6f77eaa63a9290251ffce5a060f15abc4ca64f77b38e1072557779a81f9712 Jun 06 20:23:28.214596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.214502 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" event={"ID":"2c037ed1-5959-4514-b26a-04d5df3dbd42","Type":"ContainerStarted","Data":"cd6f77eaa63a9290251ffce5a060f15abc4ca64f77b38e1072557779a81f9712"} Jun 06 20:23:28.216719 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.216696 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"38f1971808e7307229df234ff735b030677e12be6067635a2d49955b9ad0121a"} Jun 06 20:23:28.216823 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.216752 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"e90f5ae6ee76184296461ed9f4e81ba650e6ac9ed10c0c8b8f7e48ee3e55f88e"} Jun 06 20:23:28.216823 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.216785 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"7b85e702a4f33cd304adbb963862475c12ff579a1b20f1a47ed1dfb17af2079c"} Jun 06 20:23:28.748584 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.748546 2537 patch_prober.go:28] interesting pod/image-registry-7454fdb49b-ngfnx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 20:23:28.749014 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:28.748610 2537 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:23:29.111074 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.110983 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:23:29.115411 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.115385 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.118232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.118095 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 20:23:29.118379 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.118347 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 20:23:29.118444 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.118399 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 20:23:29.118711 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.118689 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ffb0l126k6o0r\"" Jun 06 20:23:29.118711 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.118707 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 20:23:29.119211 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119174 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sgk6m\"" Jun 06 20:23:29.119211 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119198 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 20:23:29.119398 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119182 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 20:23:29.119462 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119446 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 20:23:29.119520 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119463 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 20:23:29.119572 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119521 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 20:23:29.119632 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119611 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 20:23:29.119725 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119710 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 20:23:29.119982 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.119968 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 20:23:29.120055 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.120004 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 20:23:29.120129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.120004 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 20:23:29.122532 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.122510 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 20:23:29.131700 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.131649 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:23:29.224625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.224248 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"015586d6e24d874d75582b108f0a5e089dbfaf46ded48214380ec204cc11c5e2"} Jun 06 20:23:29.224625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.224363 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"0512f782f460131b752b9dd303d0aebedc9c92a7503749d185ae96e0fe383335"} Jun 06 20:23:29.224625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.224402 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" event={"ID":"6faa1e6b-9a1b-4840-9391-eba508d9e9e7","Type":"ContainerStarted","Data":"70952c0dcd7d3db4e45411ba79024f1839bbe9c17f44fa0b00ee6ad9ee3d5438"} Jun 06 20:23:29.224904 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.224677 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:29.245308 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.245223 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" podStartSLOduration=2.547535369 podStartE2EDuration="5.245201547s" totalImagesPullingTime="2.697666178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:29.244610442 +0000 UTC m=+230.321035583" watchObservedRunningTime="2026-06-06 20:23:29.245201547 +0000 UTC m=+230.321626686" Jun 06 20:23:29.251645 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251609 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251797 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251659 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-web-config\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251797 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251724 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251797 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251764 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-config\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251797 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251791 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251999 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251842 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251999 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251893 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251999 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251934 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251999 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251971 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.251999 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.251993 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252297 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252018 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252297 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252045 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252297 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252135 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252297 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252174 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252297 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252213 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252297 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252259 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252568 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252336 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252568 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252372 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252568 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252396 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gg6g\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-kube-api-access-5gg6g\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.252568 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.252428 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-config-out\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354431 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354478 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gg6g\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-kube-api-access-5gg6g\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354509 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-config-out\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354536 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354557 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-web-config\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354587 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354610 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-config\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354633 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354672 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.354707 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355317 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355381 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355407 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355434 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355465 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355524 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.355764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355551 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.356734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355594 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.356734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355659 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.356734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355738 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.356734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355748 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.356734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.355925 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.356734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.356071 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.360137 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.357524 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.360137 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.357799 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.360137 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.358311 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.360137 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.359947 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.362590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.360473 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.362590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.361086 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.362590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.361470 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.362590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.362058 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.363636 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.363319 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-config\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.366513 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.366449 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.366513 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.366480 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.366513 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.366489 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.366950 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.366917 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.367244 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.367224 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.367406 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.367386 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-web-config\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.367610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.367570 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-config-out\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.368728 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.368704 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gg6g\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-kube-api-access-5gg6g\") pod \"prometheus-k8s-0\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.426947 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.426895 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:29.742367 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:29.742342 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:23:29.745621 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:29.745593 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36495606_68c9_488b_8f89_8382eca5b41b.slice/crio-e686d37ecf1bdf2f04c7ca92ebd35b8602314fa9e6e7bf627c366e24a14b659e WatchSource:0}: Error finding container e686d37ecf1bdf2f04c7ca92ebd35b8602314fa9e6e7bf627c366e24a14b659e: Status 404 returned error can't find the container with id e686d37ecf1bdf2f04c7ca92ebd35b8602314fa9e6e7bf627c366e24a14b659e Jun 06 20:23:30.229821 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:30.229776 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" event={"ID":"2c037ed1-5959-4514-b26a-04d5df3dbd42","Type":"ContainerStarted","Data":"8f05acbf94aeef1d15377e0d93a2567a39a7eadaf7a0f8608b02668d47026673"} Jun 06 20:23:30.230282 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:30.230025 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:30.231506 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:30.231472 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"e686d37ecf1bdf2f04c7ca92ebd35b8602314fa9e6e7bf627c366e24a14b659e"} Jun 06 20:23:30.236074 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:30.236037 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" Jun 06 20:23:30.245060 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:30.245008 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-75vqp" podStartSLOduration=1.763156873 podStartE2EDuration="3.244990898s" totalImagesPullingTime="1.481834025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:30.243952081 +0000 UTC m=+231.320377221" watchObservedRunningTime="2026-06-06 20:23:30.244990898 +0000 UTC m=+231.321416036" Jun 06 20:23:31.236754 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:31.236714 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414" exitCode=0 Jun 06 20:23:31.237192 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:31.236795 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414"} Jun 06 20:23:33.761770 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:33.761719 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerName="registry" containerID="cri-o://cd809718f2bb6e0ea731c28439daf8e7aaff3c2c32a79f612495b3b0a3728ba2" gracePeriod=30 Jun 06 20:23:34.252778 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.252679 2537 generic.go:356] "Generic (PLEG): container finished" podID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerID="cd809718f2bb6e0ea731c28439daf8e7aaff3c2c32a79f612495b3b0a3728ba2" exitCode=0 Jun 06 20:23:34.252778 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.252781 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" event={"ID":"bda5a7a5-9553-498c-9249-bd64e367ee97","Type":"ContainerDied","Data":"cd809718f2bb6e0ea731c28439daf8e7aaff3c2c32a79f612495b3b0a3728ba2"} Jun 06 20:23:34.295554 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.295533 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:23:34.400490 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400460 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-bound-sa-token\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400634 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400505 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf467\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-kube-api-access-pf467\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400634 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400566 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda5a7a5-9553-498c-9249-bd64e367ee97-ca-trust-extracted\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400634 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400625 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-image-registry-private-configuration\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400786 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400654 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-installation-pull-secrets\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400786 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400678 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-trusted-ca\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400786 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400713 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-certificates\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.400786 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.400737 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") pod \"bda5a7a5-9553-498c-9249-bd64e367ee97\" (UID: \"bda5a7a5-9553-498c-9249-bd64e367ee97\") " Jun 06 20:23:34.402161 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.401882 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:23:34.402161 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.402142 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:23:34.404525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.404197 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:23:34.404525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.404361 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:23:34.405865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.405825 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:23:34.406446 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.406401 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:23:34.413763 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.413732 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-kube-api-access-pf467" (OuterVolumeSpecName: "kube-api-access-pf467") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "kube-api-access-pf467". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:23:34.414049 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.414029 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bda5a7a5-9553-498c-9249-bd64e367ee97-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bda5a7a5-9553-498c-9249-bd64e367ee97" (UID: "bda5a7a5-9553-498c-9249-bd64e367ee97"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:23:34.501775 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501731 2537 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bda5a7a5-9553-498c-9249-bd64e367ee97-ca-trust-extracted\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.501775 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501777 2537 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-image-registry-private-configuration\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.502138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501792 2537 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bda5a7a5-9553-498c-9249-bd64e367ee97-installation-pull-secrets\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.502138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501807 2537 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-trusted-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.502138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501820 2537 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-certificates\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.502138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501831 2537 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-registry-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.502138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501843 2537 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-bound-sa-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:34.502138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:34.501854 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf467\" (UniqueName: \"kubernetes.io/projected/bda5a7a5-9553-498c-9249-bd64e367ee97-kube-api-access-pf467\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:23:35.239132 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.239081 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-76d7854648-sldr8" Jun 06 20:23:35.260066 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.260026 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9"} Jun 06 20:23:35.260238 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.260098 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd"} Jun 06 20:23:35.260238 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.260157 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179"} Jun 06 20:23:35.260238 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.260191 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e"} Jun 06 20:23:35.260238 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.260222 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167"} Jun 06 20:23:35.260408 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.260253 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerStarted","Data":"798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c"} Jun 06 20:23:35.261504 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.261473 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" event={"ID":"bda5a7a5-9553-498c-9249-bd64e367ee97","Type":"ContainerDied","Data":"f35619a3bd98f9ec98c5acd7dd7eab4e561964ea908cd447d3678d5f593f6c1d"} Jun 06 20:23:35.261625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.261509 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7454fdb49b-ngfnx" Jun 06 20:23:35.261625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.261531 2537 scope.go:117] "RemoveContainer" containerID="cd809718f2bb6e0ea731c28439daf8e7aaff3c2c32a79f612495b3b0a3728ba2" Jun 06 20:23:35.296920 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.296864 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4289349 podStartE2EDuration="6.296848983s" totalImagesPullingTime="3.844267596s" totalInitContainerRuntime="23.646487ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:23:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:35.295250293 +0000 UTC m=+236.371675432" watchObservedRunningTime="2026-06-06 20:23:35.296848983 +0000 UTC m=+236.373274151" Jun 06 20:23:35.307996 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.307972 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7454fdb49b-ngfnx"] Jun 06 20:23:35.312469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.312446 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7454fdb49b-ngfnx"] Jun 06 20:23:35.356553 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:35.356519 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" path="/var/lib/kubelet/pods/bda5a7a5-9553-498c-9249-bd64e367ee97/volumes" Jun 06 20:23:39.427723 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:39.427681 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:23:50.246104 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:50.246066 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:23:50.248363 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:50.248343 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45defa4b-0edc-4a3f-947f-6c25f55df3f8-metrics-certs\") pod \"network-metrics-daemon-sgvqq\" (UID: \"45defa4b-0edc-4a3f-947f-6c25f55df3f8\") " pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:23:50.356769 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:50.356736 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8wj9j\"" Jun 06 20:23:50.365069 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:50.365047 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sgvqq" Jun 06 20:23:50.495764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:50.495730 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sgvqq"] Jun 06 20:23:50.499095 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:23:50.499063 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45defa4b_0edc_4a3f_947f_6c25f55df3f8.slice/crio-7a4f84e71dd82ff74b7dbf9c1a1bb38bfc1c1803a8cb8123d64f035a3a065be6 WatchSource:0}: Error finding container 7a4f84e71dd82ff74b7dbf9c1a1bb38bfc1c1803a8cb8123d64f035a3a065be6: Status 404 returned error can't find the container with id 7a4f84e71dd82ff74b7dbf9c1a1bb38bfc1c1803a8cb8123d64f035a3a065be6 Jun 06 20:23:51.322046 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:51.321998 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sgvqq" event={"ID":"45defa4b-0edc-4a3f-947f-6c25f55df3f8","Type":"ContainerStarted","Data":"7a4f84e71dd82ff74b7dbf9c1a1bb38bfc1c1803a8cb8123d64f035a3a065be6"} Jun 06 20:23:52.327241 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:52.327204 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sgvqq" event={"ID":"45defa4b-0edc-4a3f-947f-6c25f55df3f8","Type":"ContainerStarted","Data":"bb9e51e01b552b8dc876d3ea353a4ad700c30af9de99cb976d8110e30846577f"} Jun 06 20:23:52.327697 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:52.327254 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sgvqq" event={"ID":"45defa4b-0edc-4a3f-947f-6c25f55df3f8","Type":"ContainerStarted","Data":"0d28df788e840b5582c42d83a118579233c87901bebe2714520526068f4dc416"} Jun 06 20:23:52.345582 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:23:52.345521 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sgvqq" podStartSLOduration=252.48125782 podStartE2EDuration="4m13.345505268s" totalImagesPullingTime="864.247448ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:23:52.344577366 +0000 UTC m=+253.421002505" watchObservedRunningTime="2026-06-06 20:23:52.345505268 +0000 UTC m=+253.421930407" Jun 06 20:24:05.376971 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:05.376938 2537 generic.go:356] "Generic (PLEG): container finished" podID="39d1df18-2baf-46e9-a234-9c129f9b35f7" containerID="8c57ab2a4a993727f08e5fbe1e68ad62ae30b35dd83d66dea3ddc553f253429d" exitCode=0 Jun 06 20:24:05.377435 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:05.377012 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pvglm" event={"ID":"39d1df18-2baf-46e9-a234-9c129f9b35f7","Type":"ContainerDied","Data":"8c57ab2a4a993727f08e5fbe1e68ad62ae30b35dd83d66dea3ddc553f253429d"} Jun 06 20:24:05.377435 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:05.377381 2537 scope.go:117] "RemoveContainer" containerID="8c57ab2a4a993727f08e5fbe1e68ad62ae30b35dd83d66dea3ddc553f253429d" Jun 06 20:24:05.378703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:05.378612 2537 generic.go:356] "Generic (PLEG): container finished" podID="f212a0cb-affc-4d5a-8e12-e3789cceac8d" containerID="ec19cf6269acaabfdc0e960dedc831684ac3d1a6d6bde0717d5f0e5547620f38" exitCode=0 Jun 06 20:24:05.378703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:05.378653 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" event={"ID":"f212a0cb-affc-4d5a-8e12-e3789cceac8d","Type":"ContainerDied","Data":"ec19cf6269acaabfdc0e960dedc831684ac3d1a6d6bde0717d5f0e5547620f38"} Jun 06 20:24:05.378888 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:05.378873 2537 scope.go:117] "RemoveContainer" containerID="ec19cf6269acaabfdc0e960dedc831684ac3d1a6d6bde0717d5f0e5547620f38" Jun 06 20:24:06.384628 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:06.384569 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-ct7wg" event={"ID":"f212a0cb-affc-4d5a-8e12-e3789cceac8d","Type":"ContainerStarted","Data":"6f559870ff9a7a090dc89d93e632eb1472e86101f620c161791ac33610d8712d"} Jun 06 20:24:06.386346 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:06.386322 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-pvglm" event={"ID":"39d1df18-2baf-46e9-a234-9c129f9b35f7","Type":"ContainerStarted","Data":"b44aebb0d572f8105442154477855b5cb7c94fcfcb8a5f7ed58334f9185048f9"} Jun 06 20:24:10.358948 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:10.358920 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-75vqp_2c037ed1-5959-4514-b26a-04d5df3dbd42/monitoring-plugin/0.log" Jun 06 20:24:11.757757 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:11.757723 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z85wm_1749912d-7010-41c3-bb6c-5e5e59590efc/init-textfile/0.log" Jun 06 20:24:11.959068 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:11.959018 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z85wm_1749912d-7010-41c3-bb6c-5e5e59590efc/node-exporter/0.log" Jun 06 20:24:12.158596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:12.158523 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z85wm_1749912d-7010-41c3-bb6c-5e5e59590efc/kube-rbac-proxy/0.log" Jun 06 20:24:12.959409 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:12.959382 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/init-config-reloader/0.log" Jun 06 20:24:13.159386 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:13.159355 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/prometheus/0.log" Jun 06 20:24:13.357327 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:13.357300 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/config-reloader/0.log" Jun 06 20:24:13.559139 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:13.559095 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/thanos-sidecar/0.log" Jun 06 20:24:13.758119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:13.758091 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/kube-rbac-proxy-web/0.log" Jun 06 20:24:13.958676 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:13.958646 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/kube-rbac-proxy/0.log" Jun 06 20:24:14.157863 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:14.157779 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_36495606-68c9-488b-8f89-8382eca5b41b/kube-rbac-proxy-thanos/0.log" Jun 06 20:24:14.358793 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:14.358768 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wkn82_41cdd166-fb00-47c5-bba0-edb7ce9859a2/prometheus-operator/0.log" Jun 06 20:24:14.557575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:14.557545 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wkn82_41cdd166-fb00-47c5-bba0-edb7ce9859a2/kube-rbac-proxy/0.log" Jun 06 20:24:14.958362 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:14.958288 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/thanos-query/0.log" Jun 06 20:24:15.158392 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:15.158364 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy-web/0.log" Jun 06 20:24:15.358338 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:15.358314 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy/0.log" Jun 06 20:24:15.558277 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:15.558252 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/prom-label-proxy/0.log" Jun 06 20:24:15.757701 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:15.757674 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy-rules/0.log" Jun 06 20:24:15.957625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:15.957594 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy-metrics/0.log" Jun 06 20:24:18.757614 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:18.757587 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dpkw_73187db6-5446-4b72-a0b3-ff3be6af2eb8/dns-node-resolver/0.log" Jun 06 20:24:19.757540 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:19.757512 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6x4q_f298a496-2968-4d0d-8026-0e39b5759b44/node-ca/0.log" Jun 06 20:24:19.969995 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:19.969956 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7crdx" podUID="cf504e7d-2b68-4404-96cb-3148b414abfb" Jun 06 20:24:20.159362 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:20.159275 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c897769c-tszxg_8da29d36-fca5-4625-8ce6-ef7fdfb7cfec/router/0.log" Jun 06 20:24:20.439308 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:20.439236 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7crdx" Jun 06 20:24:20.558373 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:20.558344 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktlcq_d9fa04f6-dea5-4f93-bc17-bd260da5d3ed/serve-healthcheck-canary/0.log" Jun 06 20:24:23.731078 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:23.731025 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:24:23.735516 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:23.734379 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf504e7d-2b68-4404-96cb-3148b414abfb-metrics-tls\") pod \"dns-default-7crdx\" (UID: \"cf504e7d-2b68-4404-96cb-3148b414abfb\") " pod="openshift-dns/dns-default-7crdx" Jun 06 20:24:23.742575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:23.742544 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wqmlq\"" Jun 06 20:24:23.750610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:23.750573 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7crdx" Jun 06 20:24:23.903030 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:23.901918 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7crdx"] Jun 06 20:24:23.907510 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:24:23.907478 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf504e7d_2b68_4404_96cb_3148b414abfb.slice/crio-ebb2d29da343a500a09ccba6d3551c7d0c43aef4f8cd722691ee673b271061d9 WatchSource:0}: Error finding container ebb2d29da343a500a09ccba6d3551c7d0c43aef4f8cd722691ee673b271061d9: Status 404 returned error can't find the container with id ebb2d29da343a500a09ccba6d3551c7d0c43aef4f8cd722691ee673b271061d9 Jun 06 20:24:24.458281 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:24.458162 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7crdx" event={"ID":"cf504e7d-2b68-4404-96cb-3148b414abfb","Type":"ContainerStarted","Data":"ebb2d29da343a500a09ccba6d3551c7d0c43aef4f8cd722691ee673b271061d9"} Jun 06 20:24:26.466364 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:26.466329 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7crdx" event={"ID":"cf504e7d-2b68-4404-96cb-3148b414abfb","Type":"ContainerStarted","Data":"d4187196d912ca89ca56c847feb48962a95d048ffeb404cd7b042432517b0d6c"} Jun 06 20:24:26.466853 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:26.466379 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7crdx" event={"ID":"cf504e7d-2b68-4404-96cb-3148b414abfb","Type":"ContainerStarted","Data":"26c82bc7b33f4071e56eca7d48fdeaf5c497bd3fc65fe1100f76f93de7a8a289"} Jun 06 20:24:26.466853 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:26.466471 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7crdx" Jun 06 20:24:26.483087 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:26.483036 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7crdx" podStartSLOduration=251.994575064 podStartE2EDuration="4m13.483015852s" totalImagesPullingTime="1.488440788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:24:26.482535152 +0000 UTC m=+287.558960306" watchObservedRunningTime="2026-06-06 20:24:26.483015852 +0000 UTC m=+287.559440992" Jun 06 20:24:29.427630 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:29.427599 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:29.443447 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:29.443416 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:29.492728 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:29.492705 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:36.472180 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:36.472146 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7crdx" Jun 06 20:24:39.299867 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:39.299838 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:24:39.309222 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:39.309196 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:24:39.313656 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:39.313633 2537 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 20:24:47.452031 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.451989 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:24:47.454703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.452382 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="prometheus" containerID="cri-o://798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c" gracePeriod=600 Jun 06 20:24:47.454703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.452430 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="thanos-sidecar" containerID="cri-o://80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e" gracePeriod=600 Jun 06 20:24:47.454703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.452405 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy" containerID="cri-o://4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd" gracePeriod=600 Jun 06 20:24:47.454703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.452437 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9" gracePeriod=600 Jun 06 20:24:47.454703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.452462 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="config-reloader" containerID="cri-o://ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167" gracePeriod=600 Jun 06 20:24:47.454703 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:47.452431 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-web" containerID="cri-o://3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179" gracePeriod=600 Jun 06 20:24:48.563916 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.563880 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9" exitCode=0 Jun 06 20:24:48.563916 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.563915 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd" exitCode=0 Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.563926 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e" exitCode=0 Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.563936 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167" exitCode=0 Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.563944 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c" exitCode=0 Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.563947 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9"} Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.564032 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd"} Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.564076 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e"} Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.564136 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167"} Jun 06 20:24:48.564357 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.564175 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c"} Jun 06 20:24:48.698300 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.698275 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:48.748161 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748129 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748170 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-thanos-prometheus-http-client-file\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748198 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gg6g\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-kube-api-access-5gg6g\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748354 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748231 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-2\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748575 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748549 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.748701 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748589 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-config\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748701 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748686 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-trusted-ca-bundle\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748823 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748725 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-serving-certs-ca-bundle\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748823 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748767 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-kube-rbac-proxy\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.748823 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748797 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749025 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748829 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-kubelet-serving-ca-bundle\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749025 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748861 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-metrics-client-certs\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749025 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748893 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-0\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749025 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748941 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-web-config\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749025 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748965 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-metrics-client-ca\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749025 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.748991 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-tls-assets\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749028 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-1\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749056 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-db\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749081 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-config-out\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749141 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749160 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-tls\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749180 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.749366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749195 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-grpc-tls\") pod \"36495606-68c9-488b-8f89-8382eca5b41b\" (UID: \"36495606-68c9-488b-8f89-8382eca5b41b\") " Jun 06 20:24:48.749722 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749499 2537 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.749722 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749518 2537 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.749722 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749533 2537 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.749949 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.749925 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.751431 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.751407 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-config" (OuterVolumeSpecName: "config") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.751812 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.751787 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.751916 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.751842 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.752019 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.751996 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.752462 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.752434 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:24:48.752560 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.752463 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-config-out" (OuterVolumeSpecName: "config-out") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:24:48.753629 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.753598 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:24:48.754093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.753978 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.754093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.754068 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.754351 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.754323 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-kube-api-access-5gg6g" (OuterVolumeSpecName: "kube-api-access-5gg6g") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "kube-api-access-5gg6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:24:48.754559 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.754525 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.755310 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.755225 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.755310 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.755279 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.755310 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.755298 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:24:48.755921 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.755902 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.767631 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.767606 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-web-config" (OuterVolumeSpecName: "web-config") pod "36495606-68c9-488b-8f89-8382eca5b41b" (UID: "36495606-68c9-488b-8f89-8382eca5b41b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850558 2537 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-kube-rbac-proxy\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850589 2537 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850600 2537 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850609 2537 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-metrics-client-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850620 2537 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850629 2537 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-web-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850637 2537 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-configmap-metrics-client-ca\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850646 2537 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-tls-assets\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.850650 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850654 2537 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850662 2537 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-prometheus-k8s-db\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850670 2537 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/36495606-68c9-488b-8f89-8382eca5b41b-config-out\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850678 2537 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850686 2537 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-grpc-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850694 2537 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850702 2537 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850710 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gg6g\" (UniqueName: \"kubernetes.io/projected/36495606-68c9-488b-8f89-8382eca5b41b-kube-api-access-5gg6g\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:48.851058 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:48.850719 2537 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/36495606-68c9-488b-8f89-8382eca5b41b-config\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:24:49.570774 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.570745 2537 generic.go:356] "Generic (PLEG): container finished" podID="36495606-68c9-488b-8f89-8382eca5b41b" containerID="3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179" exitCode=0 Jun 06 20:24:49.571155 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.570816 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.571155 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.570832 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179"} Jun 06 20:24:49.571155 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.570904 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"36495606-68c9-488b-8f89-8382eca5b41b","Type":"ContainerDied","Data":"e686d37ecf1bdf2f04c7ca92ebd35b8602314fa9e6e7bf627c366e24a14b659e"} Jun 06 20:24:49.571155 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.570948 2537 scope.go:117] "RemoveContainer" containerID="4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9" Jun 06 20:24:49.578990 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.578970 2537 scope.go:117] "RemoveContainer" containerID="4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd" Jun 06 20:24:49.585713 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.585698 2537 scope.go:117] "RemoveContainer" containerID="3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179" Jun 06 20:24:49.592031 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.592009 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:24:49.592623 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.592609 2537 scope.go:117] "RemoveContainer" containerID="80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e" Jun 06 20:24:49.596962 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.596943 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:24:49.599353 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.599338 2537 scope.go:117] "RemoveContainer" containerID="ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167" Jun 06 20:24:49.605547 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.605531 2537 scope.go:117] "RemoveContainer" containerID="798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c" Jun 06 20:24:49.612619 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.612605 2537 scope.go:117] "RemoveContainer" containerID="62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414" Jun 06 20:24:49.619163 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619144 2537 scope.go:117] "RemoveContainer" containerID="4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9" Jun 06 20:24:49.619421 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.619401 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9\": container with ID starting with 4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9 not found: ID does not exist" containerID="4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9" Jun 06 20:24:49.619473 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619429 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9"} err="failed to get container status \"4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9\": rpc error: code = NotFound desc = could not find container \"4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9\": container with ID starting with 4bf36682e3e80d37939cffff23b69233d6d413183e7ad2b263d437a39747e5c9 not found: ID does not exist" Jun 06 20:24:49.619473 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619457 2537 scope.go:117] "RemoveContainer" containerID="4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd" Jun 06 20:24:49.619677 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.619660 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd\": container with ID starting with 4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd not found: ID does not exist" containerID="4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd" Jun 06 20:24:49.619734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619690 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd"} err="failed to get container status \"4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd\": rpc error: code = NotFound desc = could not find container \"4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd\": container with ID starting with 4248ec72aab605af1a43656ab45ada5f5c9c0309a6e033ee66924a784b4102bd not found: ID does not exist" Jun 06 20:24:49.619734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619713 2537 scope.go:117] "RemoveContainer" containerID="3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179" Jun 06 20:24:49.619952 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.619934 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179\": container with ID starting with 3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179 not found: ID does not exist" containerID="3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179" Jun 06 20:24:49.619991 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619958 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179"} err="failed to get container status \"3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179\": rpc error: code = NotFound desc = could not find container \"3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179\": container with ID starting with 3549074ac8526fcc0d779bb9e07bfd5758c1046cb58df92f0a5c647ab5496179 not found: ID does not exist" Jun 06 20:24:49.619991 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.619974 2537 scope.go:117] "RemoveContainer" containerID="80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e" Jun 06 20:24:49.620322 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.620302 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e\": container with ID starting with 80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e not found: ID does not exist" containerID="80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e" Jun 06 20:24:49.620390 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.620329 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e"} err="failed to get container status \"80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e\": rpc error: code = NotFound desc = could not find container \"80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e\": container with ID starting with 80f758a441257fbc25ef793ddc48b095a998b9a13ffce35dec6309b797d4ba8e not found: ID does not exist" Jun 06 20:24:49.620390 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.620348 2537 scope.go:117] "RemoveContainer" containerID="ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167" Jun 06 20:24:49.620620 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.620604 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167\": container with ID starting with ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167 not found: ID does not exist" containerID="ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167" Jun 06 20:24:49.620658 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.620625 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167"} err="failed to get container status \"ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167\": rpc error: code = NotFound desc = could not find container \"ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167\": container with ID starting with ad6e8708c32f7f1a58575d635c358d242b07c50799f5c8dd3961730121087167 not found: ID does not exist" Jun 06 20:24:49.620658 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.620639 2537 scope.go:117] "RemoveContainer" containerID="798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c" Jun 06 20:24:49.620855 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.620840 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c\": container with ID starting with 798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c not found: ID does not exist" containerID="798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c" Jun 06 20:24:49.620901 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.620857 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c"} err="failed to get container status \"798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c\": rpc error: code = NotFound desc = could not find container \"798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c\": container with ID starting with 798e9eb9aafabb846c0bf2ca0f58f965a788abbe19c9da2bb5905f6bd743184c not found: ID does not exist" Jun 06 20:24:49.620901 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.620869 2537 scope.go:117] "RemoveContainer" containerID="62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414" Jun 06 20:24:49.621090 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:24:49.621075 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414\": container with ID starting with 62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414 not found: ID does not exist" containerID="62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414" Jun 06 20:24:49.621162 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.621098 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414"} err="failed to get container status \"62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414\": rpc error: code = NotFound desc = could not find container \"62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414\": container with ID starting with 62f7ad35933f2dd559b8925a5d66d4992f122ae6f299134cd9390dd79f619414 not found: ID does not exist" Jun 06 20:24:49.624860 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.624840 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:24:49.625186 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625171 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625189 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625198 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="config-reloader" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625206 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="config-reloader" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625220 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="prometheus" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625228 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="prometheus" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625240 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="init-config-reloader" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625248 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="init-config-reloader" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625259 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-thanos" Jun 06 20:24:49.625267 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625267 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-thanos" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625280 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-web" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625289 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-web" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625304 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerName="registry" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625312 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerName="registry" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625324 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="thanos-sidecar" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625332 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="thanos-sidecar" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625402 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="thanos-sidecar" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625413 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-thanos" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625426 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy-web" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625451 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="kube-rbac-proxy" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625460 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="bda5a7a5-9553-498c-9249-bd64e367ee97" containerName="registry" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625468 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="prometheus" Jun 06 20:24:49.625681 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.625477 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="36495606-68c9-488b-8f89-8382eca5b41b" containerName="config-reloader" Jun 06 20:24:49.630688 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.630670 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.633213 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633194 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 06 20:24:49.633305 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633257 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 06 20:24:49.633592 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633563 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sgk6m\"" Jun 06 20:24:49.633592 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633587 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 06 20:24:49.633719 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633653 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 06 20:24:49.633719 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633564 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 06 20:24:49.633813 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633572 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ffb0l126k6o0r\"" Jun 06 20:24:49.633896 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633879 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 06 20:24:49.633959 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.633945 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 06 20:24:49.634525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.634361 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 06 20:24:49.634525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.634419 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 06 20:24:49.634525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.634459 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 06 20:24:49.634525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.634476 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 06 20:24:49.634525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.634422 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 06 20:24:49.634763 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.634529 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 06 20:24:49.636369 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.636353 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 06 20:24:49.639572 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.639555 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 06 20:24:49.645388 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.645369 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:24:49.758381 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758346 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758381 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758382 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758402 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758439 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758503 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7084be06-f82e-47ed-9ce5-a508d895df23-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758527 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758550 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758603 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758572 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758622 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758683 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758706 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758723 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-config\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758749 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-web-config\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758768 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gn7\" (UniqueName: \"kubernetes.io/projected/7084be06-f82e-47ed-9ce5-a508d895df23-kube-api-access-r7gn7\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.758787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758785 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.759034 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758806 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.759034 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758842 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7084be06-f82e-47ed-9ce5-a508d895df23-config-out\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.759034 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758879 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.759034 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758904 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.759034 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.758920 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859415 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859378 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7084be06-f82e-47ed-9ce5-a508d895df23-config-out\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859415 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859418 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859438 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859454 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859476 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859521 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859554 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859604 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859644 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7084be06-f82e-47ed-9ce5-a508d895df23-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.859698 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859673 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859705 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859744 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859788 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859825 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859853 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859877 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-config\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859904 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-web-config\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859929 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gn7\" (UniqueName: \"kubernetes.io/projected/7084be06-f82e-47ed-9ce5-a508d895df23-kube-api-access-r7gn7\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859936 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.859955 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860076 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.860001 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.860275 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.860578 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860763 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.860724 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.860837 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.860812 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.862548 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.862514 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7084be06-f82e-47ed-9ce5-a508d895df23-config-out\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.862548 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.862545 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.862739 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.862699 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.863727 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.863195 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.863727 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.863347 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-config\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.863727 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.863427 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.863727 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.863441 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7084be06-f82e-47ed-9ce5-a508d895df23-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.863727 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.863470 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.864070 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.863862 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.864448 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.864427 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.864753 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.864735 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-web-config\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.865409 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.865383 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.866250 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.866231 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7084be06-f82e-47ed-9ce5-a508d895df23-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.866387 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.866268 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7084be06-f82e-47ed-9ce5-a508d895df23-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.871506 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.871456 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gn7\" (UniqueName: \"kubernetes.io/projected/7084be06-f82e-47ed-9ce5-a508d895df23-kube-api-access-r7gn7\") pod \"prometheus-k8s-0\" (UID: \"7084be06-f82e-47ed-9ce5-a508d895df23\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:49.941268 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:49.941225 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:24:50.088624 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:50.088552 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 06 20:24:50.093480 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:24:50.091300 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7084be06_f82e_47ed_9ce5_a508d895df23.slice/crio-ee11dc99d56a33f3b475cacd48e162aa9a8e99e48fcfb7070837f7a75fd42207 WatchSource:0}: Error finding container ee11dc99d56a33f3b475cacd48e162aa9a8e99e48fcfb7070837f7a75fd42207: Status 404 returned error can't find the container with id ee11dc99d56a33f3b475cacd48e162aa9a8e99e48fcfb7070837f7a75fd42207 Jun 06 20:24:50.576978 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:50.576944 2537 generic.go:356] "Generic (PLEG): container finished" podID="7084be06-f82e-47ed-9ce5-a508d895df23" containerID="c0cd132ab7868858325c9237536856e1409a5fcc07f3f6d1329bd9af5b5c5ca0" exitCode=0 Jun 06 20:24:50.577409 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:50.577030 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerDied","Data":"c0cd132ab7868858325c9237536856e1409a5fcc07f3f6d1329bd9af5b5c5ca0"} Jun 06 20:24:50.577409 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:50.577099 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"ee11dc99d56a33f3b475cacd48e162aa9a8e99e48fcfb7070837f7a75fd42207"} Jun 06 20:24:51.358955 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.358913 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36495606-68c9-488b-8f89-8382eca5b41b" path="/var/lib/kubelet/pods/36495606-68c9-488b-8f89-8382eca5b41b/volumes" Jun 06 20:24:51.585576 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.585544 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"e5438b2a4c59572772ae2d396239c93c3aa34d4f69d74a144bb333aa8dc44aec"} Jun 06 20:24:51.585977 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.585610 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"f623626f1da921bc14166bc974548ed9b2b4d14357434c18b81e4399e7814d20"} Jun 06 20:24:51.585977 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.585636 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"012cfc81febad62b6096ac8f27c2ee80cd056b6ed9f39b3bb9562edbef79ef6a"} Jun 06 20:24:51.585977 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.585663 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"00370c617c4f80b9527ad2e3cc1cd773ca48ed1baa9b79581fbdce35a04e776a"} Jun 06 20:24:51.585977 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.585687 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"cab684443e1b871b637a607484f9f12936ce97b52a3a859b6e2fecc4895cce57"} Jun 06 20:24:51.585977 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.585710 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7084be06-f82e-47ed-9ce5-a508d895df23","Type":"ContainerStarted","Data":"d846c1c2e4bd6c27c954ff9cb7ab6ae40daeb37602d7575f389228d4490bf71d"} Jun 06 20:24:51.613657 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:51.613535 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.594954008 podStartE2EDuration="2.613514233s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.560225ms" isStatefulPod=false podCreationTimestamp="2026-06-06 20:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:24:51.612077612 +0000 UTC m=+312.688502770" watchObservedRunningTime="2026-06-06 20:24:51.613514233 +0000 UTC m=+312.689939376" Jun 06 20:24:54.942268 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:24:54.942230 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:25:49.942018 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:25:49.941984 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:25:49.957640 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:25:49.957612 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:25:50.824500 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:25:50.824475 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 06 20:28:13.093967 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.093935 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-krhqs"] Jun 06 20:28:13.096455 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.096439 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.099077 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.099050 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 20:28:13.099077 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.099059 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 20:28:13.100088 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.100067 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hp2jd\"" Jun 06 20:28:13.106320 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.106301 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-krhqs"] Jun 06 20:28:13.143353 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.143312 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048-bound-sa-token\") pod \"cert-manager-59c77684cc-krhqs\" (UID: \"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048\") " pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.143353 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.143351 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skq4\" (UniqueName: \"kubernetes.io/projected/29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048-kube-api-access-9skq4\") pod \"cert-manager-59c77684cc-krhqs\" (UID: \"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048\") " pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.244252 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.244218 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048-bound-sa-token\") pod \"cert-manager-59c77684cc-krhqs\" (UID: \"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048\") " pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.244252 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.244258 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skq4\" (UniqueName: \"kubernetes.io/projected/29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048-kube-api-access-9skq4\") pod \"cert-manager-59c77684cc-krhqs\" (UID: \"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048\") " pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.252449 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.252418 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048-bound-sa-token\") pod \"cert-manager-59c77684cc-krhqs\" (UID: \"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048\") " pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.252677 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.252657 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skq4\" (UniqueName: \"kubernetes.io/projected/29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048-kube-api-access-9skq4\") pod \"cert-manager-59c77684cc-krhqs\" (UID: \"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048\") " pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.414513 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.414433 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-krhqs" Jun 06 20:28:13.539470 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.539436 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-krhqs"] Jun 06 20:28:13.542783 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:28:13.542757 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29bc4b9a_1a6f_487b_a1f1_f4fdd5dce048.slice/crio-d6779956bf2fb58ba543dcd66653e9bcb2d113656ba5ddb48787af1c01568fe8 WatchSource:0}: Error finding container d6779956bf2fb58ba543dcd66653e9bcb2d113656ba5ddb48787af1c01568fe8: Status 404 returned error can't find the container with id d6779956bf2fb58ba543dcd66653e9bcb2d113656ba5ddb48787af1c01568fe8 Jun 06 20:28:13.544731 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:13.544711 2537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:28:14.348240 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:14.348173 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-krhqs" event={"ID":"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048","Type":"ContainerStarted","Data":"d6779956bf2fb58ba543dcd66653e9bcb2d113656ba5ddb48787af1c01568fe8"} Jun 06 20:28:16.357929 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:16.357893 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-krhqs" event={"ID":"29bc4b9a-1a6f-487b-a1f1-f4fdd5dce048","Type":"ContainerStarted","Data":"b01f5583ecd9a8cfcf7b4204acc92dde5f44bccaddfe78081e915546853ab12f"} Jun 06 20:28:16.376748 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:16.376695 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-krhqs" podStartSLOduration=0.683621431 podStartE2EDuration="3.376680405s" totalImagesPullingTime="2.693058974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:28:16.375195417 +0000 UTC m=+517.451620556" watchObservedRunningTime="2026-06-06 20:28:16.376680405 +0000 UTC m=+517.453105543" Jun 06 20:28:38.066536 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.066453 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j"] Jun 06 20:28:38.070787 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.070755 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.073970 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.073950 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 20:28:38.074146 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.074132 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vbcvb\"" Jun 06 20:28:38.074223 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.074162 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 20:28:38.074223 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.074171 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 20:28:38.074555 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.074538 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 20:28:38.085536 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.085512 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j"] Jun 06 20:28:38.160316 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.160276 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-webhook-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.160481 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.160325 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-tmp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.160481 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.160347 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-manifests\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.160481 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.160393 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.160586 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.160499 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqnz2\" (UniqueName: \"kubernetes.io/projected/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-kube-api-access-rqnz2\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.261059 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.261021 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-manifests\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.261059 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.261064 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.261337 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.261160 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqnz2\" (UniqueName: \"kubernetes.io/projected/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-kube-api-access-rqnz2\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.261337 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.261214 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-webhook-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.261337 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.261258 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-tmp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.261496 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.261428 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-manifests\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.263375 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.263353 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-tmp\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.263635 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.263611 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-webhook-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.263677 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.263642 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.272780 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.272756 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqnz2\" (UniqueName: \"kubernetes.io/projected/1f8a4f78-cc2c-454d-9e04-2425b34f5f66-kube-api-access-rqnz2\") pod \"opendatahub-operator-controller-manager-6757f99dd5-wkl6j\" (UID: \"1f8a4f78-cc2c-454d-9e04-2425b34f5f66\") " pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.382516 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.382428 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:38.551026 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:38.550992 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j"] Jun 06 20:28:38.555712 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:28:38.555676 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8a4f78_cc2c_454d_9e04_2425b34f5f66.slice/crio-05f706d86561344b9e02003f0476b999d5a9d3bb2817ba8bf1fb03a7f42428f9 WatchSource:0}: Error finding container 05f706d86561344b9e02003f0476b999d5a9d3bb2817ba8bf1fb03a7f42428f9: Status 404 returned error can't find the container with id 05f706d86561344b9e02003f0476b999d5a9d3bb2817ba8bf1fb03a7f42428f9 Jun 06 20:28:39.451278 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:39.451245 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" event={"ID":"1f8a4f78-cc2c-454d-9e04-2425b34f5f66","Type":"ContainerStarted","Data":"05f706d86561344b9e02003f0476b999d5a9d3bb2817ba8bf1fb03a7f42428f9"} Jun 06 20:28:41.461598 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:41.461558 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" event={"ID":"1f8a4f78-cc2c-454d-9e04-2425b34f5f66","Type":"ContainerStarted","Data":"bc29ef720646e70185bb785df857adbdf5d0fe91e813804548eb37a11a575b27"} Jun 06 20:28:42.467151 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:42.467097 2537 generic.go:356] "Generic (PLEG): container finished" podID="1f8a4f78-cc2c-454d-9e04-2425b34f5f66" containerID="bc29ef720646e70185bb785df857adbdf5d0fe91e813804548eb37a11a575b27" exitCode=0 Jun 06 20:28:42.467151 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:42.467144 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" event={"ID":"1f8a4f78-cc2c-454d-9e04-2425b34f5f66","Type":"ContainerDied","Data":"bc29ef720646e70185bb785df857adbdf5d0fe91e813804548eb37a11a575b27"} Jun 06 20:28:43.473595 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:43.473544 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" event={"ID":"1f8a4f78-cc2c-454d-9e04-2425b34f5f66","Type":"ContainerStarted","Data":"96741a668ba24e5b24d3caf5c5987aca79531b315b078303725c8d10cd724f78"} Jun 06 20:28:43.474192 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:43.473616 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:28:43.496062 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:43.496007 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" podStartSLOduration=1.341818025 podStartE2EDuration="5.495992524s" totalImagesPullingTime="3.131837894s" totalInitContainerRuntime="1.022336605s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:28:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:28:43.493642455 +0000 UTC m=+544.570067595" watchObservedRunningTime="2026-06-06 20:28:43.495992524 +0000 UTC m=+544.572417662" Jun 06 20:28:54.479649 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:28:54.479618 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6757f99dd5-wkl6j" Jun 06 20:29:05.491451 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.491414 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-844cc775f9-cps29"] Jun 06 20:29:05.496045 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.496024 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.499706 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.499682 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 06 20:29:05.499706 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.499699 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 06 20:29:05.500095 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.499694 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cjvqt\"" Jun 06 20:29:05.500095 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.499885 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 06 20:29:05.500095 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.499960 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 06 20:29:05.500095 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.499962 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 06 20:29:05.504822 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.504802 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-844cc775f9-cps29"] Jun 06 20:29:05.578120 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.578086 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2060cd7b-c271-48dc-beac-c8cba42becf1-cert\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.578299 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.578150 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2060cd7b-c271-48dc-beac-c8cba42becf1-metrics-cert\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.578299 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.578242 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2060cd7b-c271-48dc-beac-c8cba42becf1-manager-config\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.578299 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.578275 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzr5l\" (UniqueName: \"kubernetes.io/projected/2060cd7b-c271-48dc-beac-c8cba42becf1-kube-api-access-tzr5l\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.678895 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.678862 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2060cd7b-c271-48dc-beac-c8cba42becf1-cert\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.678895 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.678899 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2060cd7b-c271-48dc-beac-c8cba42becf1-metrics-cert\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.679132 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.678947 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2060cd7b-c271-48dc-beac-c8cba42becf1-manager-config\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.679132 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.678985 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzr5l\" (UniqueName: \"kubernetes.io/projected/2060cd7b-c271-48dc-beac-c8cba42becf1-kube-api-access-tzr5l\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.679636 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.679615 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2060cd7b-c271-48dc-beac-c8cba42becf1-manager-config\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.681539 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.681515 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2060cd7b-c271-48dc-beac-c8cba42becf1-cert\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.681642 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.681549 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2060cd7b-c271-48dc-beac-c8cba42becf1-metrics-cert\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.687073 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.687047 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzr5l\" (UniqueName: \"kubernetes.io/projected/2060cd7b-c271-48dc-beac-c8cba42becf1-kube-api-access-tzr5l\") pod \"lws-controller-manager-844cc775f9-cps29\" (UID: \"2060cd7b-c271-48dc-beac-c8cba42becf1\") " pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.806659 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.806571 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:05.954401 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:05.954363 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-844cc775f9-cps29"] Jun 06 20:29:05.958740 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:29:05.958710 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2060cd7b_c271_48dc_beac_c8cba42becf1.slice/crio-a5f9b98faac001aa1932c1bd612edf38dd57533f9debf16633484393e6face61 WatchSource:0}: Error finding container a5f9b98faac001aa1932c1bd612edf38dd57533f9debf16633484393e6face61: Status 404 returned error can't find the container with id a5f9b98faac001aa1932c1bd612edf38dd57533f9debf16633484393e6face61 Jun 06 20:29:06.557841 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:06.557804 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" event={"ID":"2060cd7b-c271-48dc-beac-c8cba42becf1","Type":"ContainerStarted","Data":"a5f9b98faac001aa1932c1bd612edf38dd57533f9debf16633484393e6face61"} Jun 06 20:29:09.575173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:09.575131 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" event={"ID":"2060cd7b-c271-48dc-beac-c8cba42becf1","Type":"ContainerStarted","Data":"bee40434da721299e5678c5a47a729fc3df02c64c109b7e9ff06b8df7091618e"} Jun 06 20:29:09.575656 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:09.575259 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:09.594545 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:09.594495 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" podStartSLOduration=1.876508384 podStartE2EDuration="4.594479322s" totalImagesPullingTime="2.717970938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:09.593371778 +0000 UTC m=+570.669796920" watchObservedRunningTime="2026-06-06 20:29:09.594479322 +0000 UTC m=+570.670904460" Jun 06 20:29:20.581471 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:20.581434 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-844cc775f9-cps29" Jun 06 20:29:33.789176 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.789144 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf"] Jun 06 20:29:33.792596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.792574 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.795942 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.795914 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 20:29:33.796060 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.795986 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-l75tg\"" Jun 06 20:29:33.804491 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.804467 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf"] Jun 06 20:29:33.937906 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.937870 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938080 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.937919 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938080 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.937943 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938080 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.938048 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.938086 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.938137 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.938165 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.938186 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgx67\" (UniqueName: \"kubernetes.io/projected/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-kube-api-access-hgx67\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:33.938249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:33.938231 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039092 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039053 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039314 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039102 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039314 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039141 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039314 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039194 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039314 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039223 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039304 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039355 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039386 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgx67\" (UniqueName: \"kubernetes.io/projected/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-kube-api-access-hgx67\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039419 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.039871 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039848 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.040049 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.040010 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.040049 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039981 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.040228 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.039871 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.040336 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.040314 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.041731 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.041704 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.041813 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.041766 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.057310 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.057278 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.057464 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.057445 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgx67\" (UniqueName: \"kubernetes.io/projected/05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f-kube-api-access-hgx67\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k7snf\" (UID: \"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.103485 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.103445 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:34.240642 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.240618 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf"] Jun 06 20:29:34.243221 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:29:34.243198 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05aa8e4b_eb3b_432b_9b1d_bd55c2aa8e9f.slice/crio-5c543babc2e23c79e1b0feee2c017ec40aa777e1ca615b400d1ef0e056f6b33d WatchSource:0}: Error finding container 5c543babc2e23c79e1b0feee2c017ec40aa777e1ca615b400d1ef0e056f6b33d: Status 404 returned error can't find the container with id 5c543babc2e23c79e1b0feee2c017ec40aa777e1ca615b400d1ef0e056f6b33d Jun 06 20:29:34.685867 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:34.685830 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" event={"ID":"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f","Type":"ContainerStarted","Data":"5c543babc2e23c79e1b0feee2c017ec40aa777e1ca615b400d1ef0e056f6b33d"} Jun 06 20:29:35.039311 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.039279 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7c6d865764-hcbgv"] Jun 06 20:29:35.044043 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.044017 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.046770 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.046750 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nkcqd\"" Jun 06 20:29:35.046864 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.046750 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 20:29:35.053860 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.053835 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c6d865764-hcbgv"] Jun 06 20:29:35.148997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.148747 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxddb\" (UniqueName: \"kubernetes.io/projected/48aa8c47-b9c4-4619-94d7-601f69a0595c-kube-api-access-cxddb\") pod \"dashboard-redirect-7c6d865764-hcbgv\" (UID: \"48aa8c47-b9c4-4619-94d7-601f69a0595c\") " pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.148997 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.148805 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48aa8c47-b9c4-4619-94d7-601f69a0595c-redirect-config\") pod \"dashboard-redirect-7c6d865764-hcbgv\" (UID: \"48aa8c47-b9c4-4619-94d7-601f69a0595c\") " pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.250877 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.250286 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxddb\" (UniqueName: \"kubernetes.io/projected/48aa8c47-b9c4-4619-94d7-601f69a0595c-kube-api-access-cxddb\") pod \"dashboard-redirect-7c6d865764-hcbgv\" (UID: \"48aa8c47-b9c4-4619-94d7-601f69a0595c\") " pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.250877 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.250347 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48aa8c47-b9c4-4619-94d7-601f69a0595c-redirect-config\") pod \"dashboard-redirect-7c6d865764-hcbgv\" (UID: \"48aa8c47-b9c4-4619-94d7-601f69a0595c\") " pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.251334 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.251305 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48aa8c47-b9c4-4619-94d7-601f69a0595c-redirect-config\") pod \"dashboard-redirect-7c6d865764-hcbgv\" (UID: \"48aa8c47-b9c4-4619-94d7-601f69a0595c\") " pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.260582 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.260557 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxddb\" (UniqueName: \"kubernetes.io/projected/48aa8c47-b9c4-4619-94d7-601f69a0595c-kube-api-access-cxddb\") pod \"dashboard-redirect-7c6d865764-hcbgv\" (UID: \"48aa8c47-b9c4-4619-94d7-601f69a0595c\") " pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.360738 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.360654 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" Jun 06 20:29:35.589907 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.589827 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7c6d865764-hcbgv"] Jun 06 20:29:35.592514 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:29:35.592489 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48aa8c47_b9c4_4619_94d7_601f69a0595c.slice/crio-ce24080d4c29a1f05447183672c0ecf329db1dced7dbfa6d8dc9bb53708a9ec9 WatchSource:0}: Error finding container ce24080d4c29a1f05447183672c0ecf329db1dced7dbfa6d8dc9bb53708a9ec9: Status 404 returned error can't find the container with id ce24080d4c29a1f05447183672c0ecf329db1dced7dbfa6d8dc9bb53708a9ec9 Jun 06 20:29:35.691173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:35.691077 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" event={"ID":"48aa8c47-b9c4-4619-94d7-601f69a0595c","Type":"ContainerStarted","Data":"ce24080d4c29a1f05447183672c0ecf329db1dced7dbfa6d8dc9bb53708a9ec9"} Jun 06 20:29:38.450194 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.450150 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:29:38.450516 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.450226 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:29:38.450516 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.450256 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:29:38.710487 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.710394 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" event={"ID":"48aa8c47-b9c4-4619-94d7-601f69a0595c","Type":"ContainerStarted","Data":"976ec0664eb3c648b69bde208e8d5b3d9878e50f92bc1c0ea627ce9e76e1032a"} Jun 06 20:29:38.712053 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.712023 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" event={"ID":"05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f","Type":"ContainerStarted","Data":"93d29b078cf14c5231342991da965df163c65efdbd192c548cf3b2421b687ef5"} Jun 06 20:29:38.726053 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.726001 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7c6d865764-hcbgv" podStartSLOduration=0.818538891 podStartE2EDuration="3.725985149s" totalImagesPullingTime="2.907446258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:38.725120814 +0000 UTC m=+599.801545947" watchObservedRunningTime="2026-06-06 20:29:38.725985149 +0000 UTC m=+599.802410287" Jun 06 20:29:38.745400 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:38.745332 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" podStartSLOduration=1.540496289 podStartE2EDuration="5.745308299s" totalImagesPullingTime="4.20481201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:29:38.74347954 +0000 UTC m=+599.819904676" watchObservedRunningTime="2026-06-06 20:29:38.745308299 +0000 UTC m=+599.821733440" Jun 06 20:29:39.104254 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:39.104215 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:39.109163 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:39.109137 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:39.344395 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:39.344367 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:29:39.344581 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:39.344565 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:29:39.716384 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:39.716348 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:39.717376 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:39.717356 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k7snf" Jun 06 20:29:58.392485 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.392403 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxd29"] Jun 06 20:29:58.395767 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.395745 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:29:58.398406 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.398335 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 20:29:58.398536 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.398432 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xm4ck\"" Jun 06 20:29:58.399422 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.399400 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 20:29:58.406713 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.406690 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxd29"] Jun 06 20:29:58.454135 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.454070 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhft\" (UniqueName: \"kubernetes.io/projected/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2-kube-api-access-2bhft\") pod \"kuadrant-operator-catalog-wxd29\" (UID: \"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2\") " pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:29:58.555159 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.555090 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhft\" (UniqueName: \"kubernetes.io/projected/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2-kube-api-access-2bhft\") pod \"kuadrant-operator-catalog-wxd29\" (UID: \"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2\") " pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:29:58.563557 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.563528 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhft\" (UniqueName: \"kubernetes.io/projected/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2-kube-api-access-2bhft\") pod \"kuadrant-operator-catalog-wxd29\" (UID: \"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2\") " pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:29:58.706669 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.706587 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:29:58.760040 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.760009 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxd29"] Jun 06 20:29:58.838667 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.838634 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxd29"] Jun 06 20:29:58.841429 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:29:58.841395 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b84cee6_d1a4_41f0_86d0_269b3d6b28e2.slice/crio-719b494e0eddd4c4ee131a64a8dff50eac488d595ca3156c18224ec4d911c9e4 WatchSource:0}: Error finding container 719b494e0eddd4c4ee131a64a8dff50eac488d595ca3156c18224ec4d911c9e4: Status 404 returned error can't find the container with id 719b494e0eddd4c4ee131a64a8dff50eac488d595ca3156c18224ec4d911c9e4 Jun 06 20:29:58.967080 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.966980 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xg4z5"] Jun 06 20:29:58.971389 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.971361 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:29:58.977064 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:58.977040 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xg4z5"] Jun 06 20:29:59.060392 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.060358 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hmpx\" (UniqueName: \"kubernetes.io/projected/62da0aff-ec99-48a6-a414-4d27bb902232-kube-api-access-9hmpx\") pod \"kuadrant-operator-catalog-xg4z5\" (UID: \"62da0aff-ec99-48a6-a414-4d27bb902232\") " pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:29:59.161891 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.161853 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hmpx\" (UniqueName: \"kubernetes.io/projected/62da0aff-ec99-48a6-a414-4d27bb902232-kube-api-access-9hmpx\") pod \"kuadrant-operator-catalog-xg4z5\" (UID: \"62da0aff-ec99-48a6-a414-4d27bb902232\") " pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:29:59.170170 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.170140 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hmpx\" (UniqueName: \"kubernetes.io/projected/62da0aff-ec99-48a6-a414-4d27bb902232-kube-api-access-9hmpx\") pod \"kuadrant-operator-catalog-xg4z5\" (UID: \"62da0aff-ec99-48a6-a414-4d27bb902232\") " pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:29:59.282261 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.282229 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:29:59.427601 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.427572 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xg4z5"] Jun 06 20:29:59.430696 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:29:59.430665 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62da0aff_ec99_48a6_a414_4d27bb902232.slice/crio-6e60f1585906525b868b365fadc98a6bf2104e592a31ee9425712c7e31579a26 WatchSource:0}: Error finding container 6e60f1585906525b868b365fadc98a6bf2104e592a31ee9425712c7e31579a26: Status 404 returned error can't find the container with id 6e60f1585906525b868b365fadc98a6bf2104e592a31ee9425712c7e31579a26 Jun 06 20:29:59.804991 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.804957 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" event={"ID":"62da0aff-ec99-48a6-a414-4d27bb902232","Type":"ContainerStarted","Data":"6e60f1585906525b868b365fadc98a6bf2104e592a31ee9425712c7e31579a26"} Jun 06 20:29:59.806391 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:29:59.806354 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" event={"ID":"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2","Type":"ContainerStarted","Data":"719b494e0eddd4c4ee131a64a8dff50eac488d595ca3156c18224ec4d911c9e4"} Jun 06 20:30:01.816641 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:01.816597 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" event={"ID":"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2","Type":"ContainerStarted","Data":"2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9"} Jun 06 20:30:01.817129 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:01.816615 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" podUID="0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" containerName="registry-server" containerID="cri-o://2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9" gracePeriod=2 Jun 06 20:30:01.818125 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:01.818085 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" event={"ID":"62da0aff-ec99-48a6-a414-4d27bb902232","Type":"ContainerStarted","Data":"9a31ec2654a0485994b0caf32c992ee01d636d35631a9eda5c0207f8550ac119"} Jun 06 20:30:01.831327 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:01.831274 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" podStartSLOduration=1.77744273 podStartE2EDuration="3.83125654s" totalImagesPullingTime="2.05381381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:01.830890993 +0000 UTC m=+622.907316132" watchObservedRunningTime="2026-06-06 20:30:01.83125654 +0000 UTC m=+622.907681680" Jun 06 20:30:01.846005 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:01.845952 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" podStartSLOduration=2.380347724 podStartE2EDuration="3.845934678s" totalImagesPullingTime="1.465586954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:29:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:01.844887668 +0000 UTC m=+622.921312808" watchObservedRunningTime="2026-06-06 20:30:01.845934678 +0000 UTC m=+622.922359816" Jun 06 20:30:02.064136 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.064098 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:30:02.189077 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.188974 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bhft\" (UniqueName: \"kubernetes.io/projected/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2-kube-api-access-2bhft\") pod \"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2\" (UID: \"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2\") " Jun 06 20:30:02.191202 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.191175 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2-kube-api-access-2bhft" (OuterVolumeSpecName: "kube-api-access-2bhft") pod "0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" (UID: "0b84cee6-d1a4-41f0-86d0-269b3d6b28e2"). InnerVolumeSpecName "kube-api-access-2bhft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:02.290138 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.290089 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bhft\" (UniqueName: \"kubernetes.io/projected/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2-kube-api-access-2bhft\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:30:02.824085 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.824051 2537 generic.go:356] "Generic (PLEG): container finished" podID="0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" containerID="2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9" exitCode=0 Jun 06 20:30:02.824529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.824094 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" Jun 06 20:30:02.824529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.824147 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" event={"ID":"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2","Type":"ContainerDied","Data":"2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9"} Jun 06 20:30:02.824529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.824200 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxd29" event={"ID":"0b84cee6-d1a4-41f0-86d0-269b3d6b28e2","Type":"ContainerDied","Data":"719b494e0eddd4c4ee131a64a8dff50eac488d595ca3156c18224ec4d911c9e4"} Jun 06 20:30:02.824529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.824222 2537 scope.go:117] "RemoveContainer" containerID="2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9" Jun 06 20:30:02.833173 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.833150 2537 scope.go:117] "RemoveContainer" containerID="2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9" Jun 06 20:30:02.833449 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:02.833430 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9\": container with ID starting with 2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9 not found: ID does not exist" containerID="2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9" Jun 06 20:30:02.833515 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.833456 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9"} err="failed to get container status \"2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9\": rpc error: code = NotFound desc = could not find container \"2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9\": container with ID starting with 2436eef9326c7ba0f28eae5137e6aca86bd6aaa949a4e71d48c51bee27713ab9 not found: ID does not exist" Jun 06 20:30:02.845193 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.845154 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxd29"] Jun 06 20:30:02.848699 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:02.848675 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxd29"] Jun 06 20:30:03.356950 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:03.356916 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" path="/var/lib/kubelet/pods/0b84cee6-d1a4-41f0-86d0-269b3d6b28e2/volumes" Jun 06 20:30:09.283391 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:09.283345 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:30:09.283809 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:09.283411 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:30:09.305705 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:09.305679 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:30:09.878748 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:09.878718 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xg4z5" Jun 06 20:30:24.937388 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.937352 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv"] Jun 06 20:30:24.937756 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.937695 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" containerName="registry-server" Jun 06 20:30:24.937756 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.937706 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" containerName="registry-server" Jun 06 20:30:24.937756 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.937752 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b84cee6-d1a4-41f0-86d0-269b3d6b28e2" containerName="registry-server" Jun 06 20:30:24.940610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.940594 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:24.943984 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.943961 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-f4rvx\"" Jun 06 20:30:24.956751 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:24.956717 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv"] Jun 06 20:30:25.097071 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:25.097025 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9655q\" (UniqueName: \"kubernetes.io/projected/a313fc9e-0a7f-4819-b9d3-8afa6df23566-kube-api-access-9655q\") pod \"authorino-operator-75cc8d5cb7-mwkgv\" (UID: \"a313fc9e-0a7f-4819-b9d3-8afa6df23566\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:25.197748 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:25.197656 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9655q\" (UniqueName: \"kubernetes.io/projected/a313fc9e-0a7f-4819-b9d3-8afa6df23566-kube-api-access-9655q\") pod \"authorino-operator-75cc8d5cb7-mwkgv\" (UID: \"a313fc9e-0a7f-4819-b9d3-8afa6df23566\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:25.206377 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:25.206343 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9655q\" (UniqueName: \"kubernetes.io/projected/a313fc9e-0a7f-4819-b9d3-8afa6df23566-kube-api-access-9655q\") pod \"authorino-operator-75cc8d5cb7-mwkgv\" (UID: \"a313fc9e-0a7f-4819-b9d3-8afa6df23566\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:25.251159 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:25.251098 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:25.382296 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:25.382212 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv"] Jun 06 20:30:25.386067 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:30:25.386038 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda313fc9e_0a7f_4819_b9d3_8afa6df23566.slice/crio-eefd5dacd5937ae9ae831e87e8352bee2dda21cd9635e9fd6e2269a94a6e8175 WatchSource:0}: Error finding container eefd5dacd5937ae9ae831e87e8352bee2dda21cd9635e9fd6e2269a94a6e8175: Status 404 returned error can't find the container with id eefd5dacd5937ae9ae831e87e8352bee2dda21cd9635e9fd6e2269a94a6e8175 Jun 06 20:30:25.930685 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:25.930653 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" event={"ID":"a313fc9e-0a7f-4819-b9d3-8afa6df23566","Type":"ContainerStarted","Data":"eefd5dacd5937ae9ae831e87e8352bee2dda21cd9635e9fd6e2269a94a6e8175"} Jun 06 20:30:27.941326 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:27.941240 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" event={"ID":"a313fc9e-0a7f-4819-b9d3-8afa6df23566","Type":"ContainerStarted","Data":"99828f20955d8929fadde4dc37bac0ede70ecccf2f3a661815b8ed97cb932cab"} Jun 06 20:30:27.941677 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:27.941322 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:27.956880 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:27.956830 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" podStartSLOduration=1.80913335 podStartE2EDuration="3.956814658s" totalImagesPullingTime="2.147681308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:30:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:27.956379838 +0000 UTC m=+649.032804977" watchObservedRunningTime="2026-06-06 20:30:27.956814658 +0000 UTC m=+649.033239797" Jun 06 20:30:28.584964 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.584923 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx"] Jun 06 20:30:28.588662 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.588640 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:28.591373 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.591353 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-j4hrn\"" Jun 06 20:30:28.599501 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.599474 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx"] Jun 06 20:30:28.729956 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.729920 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w2tf\" (UniqueName: \"kubernetes.io/projected/e21c98c5-8853-4908-abbc-1f68e8d9c2d4-kube-api-access-6w2tf\") pod \"limitador-operator-controller-manager-859d7b78bd-579dx\" (UID: \"e21c98c5-8853-4908-abbc-1f68e8d9c2d4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:28.830486 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.830451 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w2tf\" (UniqueName: \"kubernetes.io/projected/e21c98c5-8853-4908-abbc-1f68e8d9c2d4-kube-api-access-6w2tf\") pod \"limitador-operator-controller-manager-859d7b78bd-579dx\" (UID: \"e21c98c5-8853-4908-abbc-1f68e8d9c2d4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:28.840472 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.840415 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w2tf\" (UniqueName: \"kubernetes.io/projected/e21c98c5-8853-4908-abbc-1f68e8d9c2d4-kube-api-access-6w2tf\") pod \"limitador-operator-controller-manager-859d7b78bd-579dx\" (UID: \"e21c98c5-8853-4908-abbc-1f68e8d9c2d4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:28.899467 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:28.899430 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:29.036497 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:29.036469 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx"] Jun 06 20:30:29.037959 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:30:29.037911 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode21c98c5_8853_4908_abbc_1f68e8d9c2d4.slice/crio-09859de0091be1e9a006374e35beeb2552f1716c72e28eed61a361548917521a WatchSource:0}: Error finding container 09859de0091be1e9a006374e35beeb2552f1716c72e28eed61a361548917521a: Status 404 returned error can't find the container with id 09859de0091be1e9a006374e35beeb2552f1716c72e28eed61a361548917521a Jun 06 20:30:29.956849 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:29.956805 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" event={"ID":"e21c98c5-8853-4908-abbc-1f68e8d9c2d4","Type":"ContainerStarted","Data":"09859de0091be1e9a006374e35beeb2552f1716c72e28eed61a361548917521a"} Jun 06 20:30:30.963233 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:30.963198 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" event={"ID":"e21c98c5-8853-4908-abbc-1f68e8d9c2d4","Type":"ContainerStarted","Data":"5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d"} Jun 06 20:30:30.963646 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:30.963432 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:30.981824 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:30.981772 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" podStartSLOduration=1.2050665 podStartE2EDuration="2.98175791s" totalImagesPullingTime="1.77669141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:30:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:30.979975181 +0000 UTC m=+652.056400311" watchObservedRunningTime="2026-06-06 20:30:30.98175791 +0000 UTC m=+652.058183049" Jun 06 20:30:38.948509 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:38.948473 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwkgv" Jun 06 20:30:41.970674 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:41.970641 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:50.927886 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:50.927852 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p"] Jun 06 20:30:50.932689 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:50.932671 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:50.935296 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:50.935275 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cc89s\"" Jun 06 20:30:50.944247 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:50.944225 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p"] Jun 06 20:30:51.014972 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.014940 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8wfp\" (UniqueName: \"kubernetes.io/projected/2b6cbeb1-5bef-4b88-9a77-5015284394c6-kube-api-access-m8wfp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.015186 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.015011 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b6cbeb1-5bef-4b88-9a77-5015284394c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.034132 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.034072 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p"] Jun 06 20:30:51.034422 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:51.034394 2537 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-m8wfp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" podUID="2b6cbeb1-5bef-4b88-9a77-5015284394c6" Jun 06 20:30:51.051194 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.051160 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.057760 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.057736 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.116322 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.116287 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b6cbeb1-5bef-4b88-9a77-5015284394c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.116525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.116456 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8wfp\" (UniqueName: \"kubernetes.io/projected/2b6cbeb1-5bef-4b88-9a77-5015284394c6-kube-api-access-m8wfp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.116731 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.116710 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b6cbeb1-5bef-4b88-9a77-5015284394c6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.124715 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.124689 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8wfp\" (UniqueName: \"kubernetes.io/projected/2b6cbeb1-5bef-4b88-9a77-5015284394c6-kube-api-access-m8wfp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:51.217339 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.217248 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b6cbeb1-5bef-4b88-9a77-5015284394c6-extensions-socket-volume\") pod \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " Jun 06 20:30:51.217497 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.217359 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8wfp\" (UniqueName: \"kubernetes.io/projected/2b6cbeb1-5bef-4b88-9a77-5015284394c6-kube-api-access-m8wfp\") pod \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\" (UID: \"2b6cbeb1-5bef-4b88-9a77-5015284394c6\") " Jun 06 20:30:51.217589 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.217567 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b6cbeb1-5bef-4b88-9a77-5015284394c6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b6cbeb1-5bef-4b88-9a77-5015284394c6" (UID: "2b6cbeb1-5bef-4b88-9a77-5015284394c6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:30:51.219412 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.219391 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6cbeb1-5bef-4b88-9a77-5015284394c6-kube-api-access-m8wfp" (OuterVolumeSpecName: "kube-api-access-m8wfp") pod "2b6cbeb1-5bef-4b88-9a77-5015284394c6" (UID: "2b6cbeb1-5bef-4b88-9a77-5015284394c6"). InnerVolumeSpecName "kube-api-access-m8wfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:51.318847 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.318807 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8wfp\" (UniqueName: \"kubernetes.io/projected/2b6cbeb1-5bef-4b88-9a77-5015284394c6-kube-api-access-m8wfp\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:30:51.318847 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.318842 2537 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b6cbeb1-5bef-4b88-9a77-5015284394c6-extensions-socket-volume\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:30:51.503586 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.503550 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p"] Jun 06 20:30:51.509579 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.509547 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p"] Jun 06 20:30:51.556902 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.556863 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj"] Jun 06 20:30:51.560842 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.560819 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx"] Jun 06 20:30:51.561008 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.560986 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.561095 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.560982 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" containerName="manager" containerID="cri-o://5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d" gracePeriod=2 Jun 06 20:30:51.572332 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.572304 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx"] Jun 06 20:30:51.574854 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.574827 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj"] Jun 06 20:30:51.576090 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:51.576050 2537 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e21c98c5-8853-4908-abbc-1f68e8d9c2d4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-579dx\": pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:51.584000 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.583975 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222"] Jun 06 20:30:51.584351 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.584336 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" containerName="manager" Jun 06 20:30:51.584405 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.584353 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" containerName="manager" Jun 06 20:30:51.584439 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.584410 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" containerName="manager" Jun 06 20:30:51.587457 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.587434 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:30:51.596963 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.596936 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222"] Jun 06 20:30:51.606148 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:51.606098 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:51.608298 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:51.608268 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:51.621440 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.621414 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vqdk\" (UniqueName: \"kubernetes.io/projected/9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963-kube-api-access-2vqdk\") pod \"limitador-operator-controller-manager-859d7b78bd-bh222\" (UID: \"9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:30:51.621555 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.621472 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c4hgj\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.621555 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.621499 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dllg\" (UniqueName: \"kubernetes.io/projected/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-kube-api-access-8dllg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c4hgj\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.722688 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.722651 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c4hgj\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.722688 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.722690 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dllg\" (UniqueName: \"kubernetes.io/projected/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-kube-api-access-8dllg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c4hgj\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.722939 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.722761 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqdk\" (UniqueName: \"kubernetes.io/projected/9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963-kube-api-access-2vqdk\") pod \"limitador-operator-controller-manager-859d7b78bd-bh222\" (UID: \"9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:30:51.723102 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.723077 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c4hgj\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.732232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.732046 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vqdk\" (UniqueName: \"kubernetes.io/projected/9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963-kube-api-access-2vqdk\") pod \"limitador-operator-controller-manager-859d7b78bd-bh222\" (UID: \"9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:30:51.732232 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.732075 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dllg\" (UniqueName: \"kubernetes.io/projected/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-kube-api-access-8dllg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-c4hgj\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.787073 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.787045 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:51.789455 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:51.789427 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:51.823412 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.823372 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w2tf\" (UniqueName: \"kubernetes.io/projected/e21c98c5-8853-4908-abbc-1f68e8d9c2d4-kube-api-access-6w2tf\") pod \"e21c98c5-8853-4908-abbc-1f68e8d9c2d4\" (UID: \"e21c98c5-8853-4908-abbc-1f68e8d9c2d4\") " Jun 06 20:30:51.825380 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.825356 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e21c98c5-8853-4908-abbc-1f68e8d9c2d4-kube-api-access-6w2tf" (OuterVolumeSpecName: "kube-api-access-6w2tf") pod "e21c98c5-8853-4908-abbc-1f68e8d9c2d4" (UID: "e21c98c5-8853-4908-abbc-1f68e8d9c2d4"). InnerVolumeSpecName "kube-api-access-6w2tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:30:51.924730 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.924693 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w2tf\" (UniqueName: \"kubernetes.io/projected/e21c98c5-8853-4908-abbc-1f68e8d9c2d4-kube-api-access-6w2tf\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:30:51.940615 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.940578 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:51.945495 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:51.945475 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:30:52.058379 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.058343 2537 generic.go:356] "Generic (PLEG): container finished" podID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" containerID="5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d" exitCode=0 Jun 06 20:30:52.058529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.058415 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:52.058529 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.058488 2537 scope.go:117] "RemoveContainer" containerID="5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d" Jun 06 20:30:52.059892 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.058788 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:52.063436 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:52.063197 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:52.068056 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:52.068023 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:52.069953 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.069929 2537 scope.go:117] "RemoveContainer" containerID="5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d" Jun 06 20:30:52.070203 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:52.070172 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2b6cbeb1-5bef-4b88-9a77-5015284394c6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:52.070393 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:52.070370 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d\": container with ID starting with 5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d not found: ID does not exist" containerID="5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d" Jun 06 20:30:52.070507 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.070398 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d"} err="failed to get container status \"5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d\": rpc error: code = NotFound desc = could not find container \"5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d\": container with ID starting with 5a1535c6243de14f4b0c77c2f354bcdfddfb8ef47d82475c483f024cf01f6f4d not found: ID does not exist" Jun 06 20:30:52.072171 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:52.072101 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2b6cbeb1-5bef-4b88-9a77-5015284394c6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:52.074296 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:52.074101 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:52.087374 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.087348 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj"] Jun 06 20:30:52.090304 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:30:52.090278 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d401e67_ef65_4d47_8ca3_a4d83ac0cb26.slice/crio-d50341c3ac3fed9d2e83676e553b440cf5824ab2504cc6df656a03429c555768 WatchSource:0}: Error finding container d50341c3ac3fed9d2e83676e553b440cf5824ab2504cc6df656a03429c555768: Status 404 returned error can't find the container with id d50341c3ac3fed9d2e83676e553b440cf5824ab2504cc6df656a03429c555768 Jun 06 20:30:52.111493 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:52.111468 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222"] Jun 06 20:30:52.114038 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:30:52.114017 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a18f12a_f4e4_4b66_b3c3_ac3e6c11b963.slice/crio-cff948d0bd3fc6ea1d7bcc6ceabc7875d9db099d1fe66688fdef80c8f711ad4a WatchSource:0}: Error finding container cff948d0bd3fc6ea1d7bcc6ceabc7875d9db099d1fe66688fdef80c8f711ad4a: Status 404 returned error can't find the container with id cff948d0bd3fc6ea1d7bcc6ceabc7875d9db099d1fe66688fdef80c8f711ad4a Jun 06 20:30:53.067095 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.067054 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" event={"ID":"9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963","Type":"ContainerStarted","Data":"6462f069ccf6fc00a604f572de7e07f0d2eaa486af1f6b32e41014e4c00a20ea"} Jun 06 20:30:53.067607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.067136 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" event={"ID":"9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963","Type":"ContainerStarted","Data":"cff948d0bd3fc6ea1d7bcc6ceabc7875d9db099d1fe66688fdef80c8f711ad4a"} Jun 06 20:30:53.067607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.067268 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:30:53.068626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.068590 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" event={"ID":"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26","Type":"ContainerStarted","Data":"d50341c3ac3fed9d2e83676e553b440cf5824ab2504cc6df656a03429c555768"} Jun 06 20:30:53.084607 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.084542 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" podStartSLOduration=2.084519228 podStartE2EDuration="2.084519228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:30:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:53.08368688 +0000 UTC m=+674.160112019" watchObservedRunningTime="2026-06-06 20:30:53.084519228 +0000 UTC m=+674.160944369" Jun 06 20:30:53.085892 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:53.085856 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-26q7p\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="2b6cbeb1-5bef-4b88-9a77-5015284394c6" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-26q7p" Jun 06 20:30:53.087895 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:30:53.087862 2537 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-579dx\" is forbidden: User \"system:node:ip-10-0-131-27.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-27.ec2.internal' and this object" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-579dx" Jun 06 20:30:53.360227 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.360136 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6cbeb1-5bef-4b88-9a77-5015284394c6" path="/var/lib/kubelet/pods/2b6cbeb1-5bef-4b88-9a77-5015284394c6/volumes" Jun 06 20:30:53.360487 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:53.360461 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e21c98c5-8853-4908-abbc-1f68e8d9c2d4" path="/var/lib/kubelet/pods/e21c98c5-8853-4908-abbc-1f68e8d9c2d4/volumes" Jun 06 20:30:56.084366 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:56.084332 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" event={"ID":"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26","Type":"ContainerStarted","Data":"c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5"} Jun 06 20:30:56.084744 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:56.084397 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:30:56.106052 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:30:56.105948 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" podStartSLOduration=1.3455204809999999 podStartE2EDuration="5.105930769s" totalImagesPullingTime="3.760410288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:30:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:30:56.103667357 +0000 UTC m=+677.180092509" watchObservedRunningTime="2026-06-06 20:30:56.105930769 +0000 UTC m=+677.182356321" Jun 06 20:31:03.781430 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:03.781392 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj"] Jun 06 20:31:03.781915 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:03.781623 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" podUID="6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" containerName="manager" containerID="cri-o://c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5" gracePeriod=10 Jun 06 20:31:03.783555 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:03.783528 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:31:04.037042 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.036984 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:31:04.075252 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.075216 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bh222" Jun 06 20:31:04.125678 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.125643 2537 generic.go:356] "Generic (PLEG): container finished" podID="6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" containerID="c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5" exitCode=0 Jun 06 20:31:04.125865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.125700 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" Jun 06 20:31:04.125865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.125741 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" event={"ID":"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26","Type":"ContainerDied","Data":"c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5"} Jun 06 20:31:04.125865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.125799 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj" event={"ID":"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26","Type":"ContainerDied","Data":"d50341c3ac3fed9d2e83676e553b440cf5824ab2504cc6df656a03429c555768"} Jun 06 20:31:04.125865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.125824 2537 scope.go:117] "RemoveContainer" containerID="c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5" Jun 06 20:31:04.131643 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.131590 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dllg\" (UniqueName: \"kubernetes.io/projected/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-kube-api-access-8dllg\") pod \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " Jun 06 20:31:04.131793 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.131661 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-extensions-socket-volume\") pod \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\" (UID: \"6d401e67-ef65-4d47-8ca3-a4d83ac0cb26\") " Jun 06 20:31:04.132316 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.132231 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" (UID: "6d401e67-ef65-4d47-8ca3-a4d83ac0cb26"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:31:04.133834 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.133809 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-kube-api-access-8dllg" (OuterVolumeSpecName: "kube-api-access-8dllg") pod "6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" (UID: "6d401e67-ef65-4d47-8ca3-a4d83ac0cb26"). InnerVolumeSpecName "kube-api-access-8dllg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:31:04.135141 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.135117 2537 scope.go:117] "RemoveContainer" containerID="c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5" Jun 06 20:31:04.135441 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:31:04.135421 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5\": container with ID starting with c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5 not found: ID does not exist" containerID="c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5" Jun 06 20:31:04.135518 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.135454 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5"} err="failed to get container status \"c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5\": rpc error: code = NotFound desc = could not find container \"c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5\": container with ID starting with c4772f0bc7e4405e2ea19c894bd27aea574751665adf85ba9f1b501ff98e13f5 not found: ID does not exist" Jun 06 20:31:04.233373 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.233334 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dllg\" (UniqueName: \"kubernetes.io/projected/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-kube-api-access-8dllg\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:31:04.233373 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.233364 2537 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26-extensions-socket-volume\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:31:04.453865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.453824 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj"] Jun 06 20:31:04.460172 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:04.460141 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-c4hgj"] Jun 06 20:31:05.356986 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:05.356953 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" path="/var/lib/kubelet/pods/6d401e67-ef65-4d47-8ca3-a4d83ac0cb26/volumes" Jun 06 20:31:20.049331 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.049295 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb"] Jun 06 20:31:20.050233 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.050206 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" containerName="manager" Jun 06 20:31:20.050233 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.050230 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" containerName="manager" Jun 06 20:31:20.050423 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.050304 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d401e67-ef65-4d47-8ca3-a4d83ac0cb26" containerName="manager" Jun 06 20:31:20.054677 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.054653 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.057213 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.057188 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zbhrz\"" Jun 06 20:31:20.066130 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.066092 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb"] Jun 06 20:31:20.174172 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174122 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174346 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174181 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174346 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174236 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174346 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174259 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174346 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174337 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvvl\" (UniqueName: \"kubernetes.io/projected/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-kube-api-access-rkvvl\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174375 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174400 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174463 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.174573 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.174486 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.275723 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.275680 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.275723 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.275725 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.275932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.275750 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.275932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.275776 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.275932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.275808 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.275932 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.275839 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276166 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276016 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvvl\" (UniqueName: \"kubernetes.io/projected/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-kube-api-access-rkvvl\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276166 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276079 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276166 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276152 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276202 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276234 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276333 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276304 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276494 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276466 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.276553 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.276532 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.278289 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.278268 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.278365 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.278317 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.283221 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.283201 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.283298 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.283273 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvvl\" (UniqueName: \"kubernetes.io/projected/4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2-kube-api-access-rkvvl\") pod \"maas-default-gateway-openshift-default-687ff6996-bfrfb\" (UID: \"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.367674 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.367582 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:20.502573 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.502548 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb"] Jun 06 20:31:20.505262 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:31:20.505236 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3f409f_5dc1_45b9_a1e4_b41dc5bb89a2.slice/crio-d70f1f7ed5411a864b8e6a471654c7596243e7756edd8013bde4ad094c9cae42 WatchSource:0}: Error finding container d70f1f7ed5411a864b8e6a471654c7596243e7756edd8013bde4ad094c9cae42: Status 404 returned error can't find the container with id d70f1f7ed5411a864b8e6a471654c7596243e7756edd8013bde4ad094c9cae42 Jun 06 20:31:20.507696 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.507661 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:31:20.507791 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.507738 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:31:20.507791 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:20.507782 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:31:21.206758 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:21.206717 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" event={"ID":"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2","Type":"ContainerStarted","Data":"e67b766a710023fa8e24ac6456c0c50e690e3ce982f8da2a315ae127c1b15c49"} Jun 06 20:31:21.207182 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:21.206805 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" event={"ID":"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2","Type":"ContainerStarted","Data":"d70f1f7ed5411a864b8e6a471654c7596243e7756edd8013bde4ad094c9cae42"} Jun 06 20:31:21.228433 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:21.228373 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" podStartSLOduration=1.228358379 podStartE2EDuration="1.228358379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:31:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:31:21.226083572 +0000 UTC m=+702.302508712" watchObservedRunningTime="2026-06-06 20:31:21.228358379 +0000 UTC m=+702.304783518" Jun 06 20:31:21.368260 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:21.368228 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:21.373488 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:21.373461 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:22.212591 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:22.212515 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:22.213538 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:22.213518 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:31:33.453577 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.453541 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:31:33.457087 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.457065 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.459613 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.459589 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 20:31:33.459736 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.459669 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zldnj\"" Jun 06 20:31:33.468274 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.468233 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:31:33.480643 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.480609 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:31:33.487671 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.487641 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7-config-file\") pod \"limitador-limitador-54d6d988d5-vzkxm\" (UID: \"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.487671 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.487674 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpj7v\" (UniqueName: \"kubernetes.io/projected/dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7-kube-api-access-vpj7v\") pod \"limitador-limitador-54d6d988d5-vzkxm\" (UID: \"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.588463 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.588425 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7-config-file\") pod \"limitador-limitador-54d6d988d5-vzkxm\" (UID: \"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.588463 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.588460 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpj7v\" (UniqueName: \"kubernetes.io/projected/dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7-kube-api-access-vpj7v\") pod \"limitador-limitador-54d6d988d5-vzkxm\" (UID: \"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.589042 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.589021 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7-config-file\") pod \"limitador-limitador-54d6d988d5-vzkxm\" (UID: \"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.596156 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.596129 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpj7v\" (UniqueName: \"kubernetes.io/projected/dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7-kube-api-access-vpj7v\") pod \"limitador-limitador-54d6d988d5-vzkxm\" (UID: \"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.776283 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.776246 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:33.910657 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:33.910627 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:31:33.913996 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:31:33.913968 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb51ddc_9a7f_44ac_a6fa_8a4b79f57ae7.slice/crio-d9d4e6c3de03e3096b249350064a68a7d80c3e7a85b37a2914b92b6294ce3a3e WatchSource:0}: Error finding container d9d4e6c3de03e3096b249350064a68a7d80c3e7a85b37a2914b92b6294ce3a3e: Status 404 returned error can't find the container with id d9d4e6c3de03e3096b249350064a68a7d80c3e7a85b37a2914b92b6294ce3a3e Jun 06 20:31:34.277388 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:34.277312 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" event={"ID":"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7","Type":"ContainerStarted","Data":"d9d4e6c3de03e3096b249350064a68a7d80c3e7a85b37a2914b92b6294ce3a3e"} Jun 06 20:31:37.293506 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:37.293470 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" event={"ID":"dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7","Type":"ContainerStarted","Data":"86dac2a4562a91955695912f1a8ecf02e378371ab91eaf48abf9ffc9cd05a349"} Jun 06 20:31:37.293933 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:37.293590 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:31:37.309710 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:37.309652 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" podStartSLOduration=1.9664376730000002 podStartE2EDuration="4.309639251s" totalImagesPullingTime="2.343201578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:31:37.309197583 +0000 UTC m=+718.385622723" watchObservedRunningTime="2026-06-06 20:31:37.309639251 +0000 UTC m=+718.386064390" Jun 06 20:31:48.299569 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:31:48.299536 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vzkxm" Jun 06 20:32:22.820725 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.820690 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:32:22.828377 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.828353 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:22.831308 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.831283 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 20:32:22.831451 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.831283 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v7dpt\"" Jun 06 20:32:22.831451 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.831288 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 20:32:22.832226 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.832205 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 20:32:22.837454 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.837430 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:32:22.955534 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:22.955494 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d9nk\" (UniqueName: \"kubernetes.io/projected/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050-kube-api-access-2d9nk\") pod \"maas-keycloak-0\" (UID: \"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:23.056770 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:23.056737 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d9nk\" (UniqueName: \"kubernetes.io/projected/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050-kube-api-access-2d9nk\") pod \"maas-keycloak-0\" (UID: \"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:23.064907 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:23.064882 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d9nk\" (UniqueName: \"kubernetes.io/projected/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050-kube-api-access-2d9nk\") pod \"maas-keycloak-0\" (UID: \"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:23.139206 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:23.139101 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:23.273865 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:23.273835 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:32:23.276176 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:32:23.276148 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cabd7e5_eca0_4f4e_9f65_a39b61cc0050.slice/crio-dee139bece1c47b8b220fd083d1a56c0fecadce18ca6d9336dab4d95a433df40 WatchSource:0}: Error finding container dee139bece1c47b8b220fd083d1a56c0fecadce18ca6d9336dab4d95a433df40: Status 404 returned error can't find the container with id dee139bece1c47b8b220fd083d1a56c0fecadce18ca6d9336dab4d95a433df40 Jun 06 20:32:23.515312 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:23.515281 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050","Type":"ContainerStarted","Data":"dee139bece1c47b8b220fd083d1a56c0fecadce18ca6d9336dab4d95a433df40"} Jun 06 20:32:28.547701 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:28.547583 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050","Type":"ContainerStarted","Data":"9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2"} Jun 06 20:32:28.567724 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:28.567658 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.600260467 podStartE2EDuration="6.567636141s" totalImagesPullingTime="4.967375674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:32:28.565260066 +0000 UTC m=+769.641685207" watchObservedRunningTime="2026-06-06 20:32:28.567636141 +0000 UTC m=+769.644061290" Jun 06 20:32:29.139343 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:29.139294 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:29.141374 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:29.141334 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:30.140642 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:30.140582 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:31.139909 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:31.139867 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:32.140214 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:32.140156 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:33.139699 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:33.139650 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:33.140018 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:33.139995 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:34.140590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:34.140536 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:35.139871 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:35.139821 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:36.139887 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:36.139829 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:37.139791 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:37.139739 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:38.140438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:38.140388 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:39.140625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:39.140578 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:40.139917 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:40.139861 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 06 20:32:41.228578 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:41.228540 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 20:32:41.242419 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:41.242365 2537 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:32:51.234440 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:32:51.234400 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:35.688814 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:35.688779 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:33:43.934940 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:43.934903 2537 generic.go:356] "Generic (PLEG): container finished" podID="4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2" containerID="e67b766a710023fa8e24ac6456c0c50e690e3ce982f8da2a315ae127c1b15c49" exitCode=0 Jun 06 20:33:43.935452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:43.934963 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" event={"ID":"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2","Type":"ContainerDied","Data":"e67b766a710023fa8e24ac6456c0c50e690e3ce982f8da2a315ae127c1b15c49"} Jun 06 20:33:43.935452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:43.935357 2537 scope.go:117] "RemoveContainer" containerID="e67b766a710023fa8e24ac6456c0c50e690e3ce982f8da2a315ae127c1b15c49" Jun 06 20:33:43.936332 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:43.936297 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:33:43.936436 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:43.936383 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:33:43.936501 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:43.936432 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:33:44.950133 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:44.945982 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" event={"ID":"4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2","Type":"ContainerStarted","Data":"fe02ca028c099f5dd36012327e327ddbbd6874a96ee2be30dbdb68adf57c05b4"} Jun 06 20:33:45.368519 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:45.368482 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:33:45.368731 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:45.368713 2537 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfrfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 06 20:33:45.368783 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:45.368759 2537 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" podUID="4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 06 20:33:46.368305 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:46.368267 2537 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfrfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 06 20:33:46.368675 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:46.368336 2537 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" podUID="4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 06 20:33:46.587730 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:46.587693 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:33:46.587910 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:46.587886 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" containerID="cri-o://9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2" gracePeriod=30 Jun 06 20:33:47.368369 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:47.368332 2537 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfrfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 06 20:33:47.368744 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:47.368394 2537 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" podUID="4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 06 20:33:48.283810 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.283743 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:48.364734 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.364699 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d9nk\" (UniqueName: \"kubernetes.io/projected/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050-kube-api-access-2d9nk\") pod \"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050\" (UID: \"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050\") " Jun 06 20:33:48.367446 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.367396 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050-kube-api-access-2d9nk" (OuterVolumeSpecName: "kube-api-access-2d9nk") pod "0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" (UID: "0cabd7e5-eca0-4f4e-9f65-a39b61cc0050"). InnerVolumeSpecName "kube-api-access-2d9nk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:33:48.369217 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.368717 2537 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-bfrfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jun 06 20:33:48.369217 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.368770 2537 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" podUID="4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jun 06 20:33:48.465626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.465589 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d9nk\" (UniqueName: \"kubernetes.io/projected/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050-kube-api-access-2d9nk\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:33:48.970052 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.970009 2537 generic.go:356] "Generic (PLEG): container finished" podID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerID="9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2" exitCode=143 Jun 06 20:33:48.970052 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.970052 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:48.970279 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.970096 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050","Type":"ContainerDied","Data":"9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2"} Jun 06 20:33:48.970279 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.970163 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"0cabd7e5-eca0-4f4e-9f65-a39b61cc0050","Type":"ContainerDied","Data":"dee139bece1c47b8b220fd083d1a56c0fecadce18ca6d9336dab4d95a433df40"} Jun 06 20:33:48.970279 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.970185 2537 scope.go:117] "RemoveContainer" containerID="9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2" Jun 06 20:33:48.979635 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.979617 2537 scope.go:117] "RemoveContainer" containerID="9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2" Jun 06 20:33:48.979940 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:33:48.979917 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2\": container with ID starting with 9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2 not found: ID does not exist" containerID="9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2" Jun 06 20:33:48.980042 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.979947 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2"} err="failed to get container status \"9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2\": rpc error: code = NotFound desc = could not find container \"9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2\": container with ID starting with 9cfe63b62350e7d25db443506eaaa63c9b267953636895cd119cf4ea520269c2 not found: ID does not exist" Jun 06 20:33:48.991610 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.991583 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:33:48.995509 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:48.995485 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:33:49.017602 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.017567 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:33:49.017976 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.017963 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" Jun 06 20:33:49.018020 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.017977 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" Jun 06 20:33:49.018054 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.018043 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" containerName="keycloak" Jun 06 20:33:49.022652 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.022630 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.025591 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.025567 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 06 20:33:49.025745 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.025567 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 06 20:33:49.025745 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.025629 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 20:33:49.025745 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.025579 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 20:33:49.025745 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.025688 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v7dpt\"" Jun 06 20:33:49.033164 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.033139 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:33:49.070443 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.070410 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/256c8000-35f3-4859-a71d-8b79e5957742-test-realms\") pod \"maas-keycloak-0\" (UID: \"256c8000-35f3-4859-a71d-8b79e5957742\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.070599 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.070479 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4hrj\" (UniqueName: \"kubernetes.io/projected/256c8000-35f3-4859-a71d-8b79e5957742-kube-api-access-k4hrj\") pod \"maas-keycloak-0\" (UID: \"256c8000-35f3-4859-a71d-8b79e5957742\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.171596 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.171557 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4hrj\" (UniqueName: \"kubernetes.io/projected/256c8000-35f3-4859-a71d-8b79e5957742-kube-api-access-k4hrj\") pod \"maas-keycloak-0\" (UID: \"256c8000-35f3-4859-a71d-8b79e5957742\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.171764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.171637 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/256c8000-35f3-4859-a71d-8b79e5957742-test-realms\") pod \"maas-keycloak-0\" (UID: \"256c8000-35f3-4859-a71d-8b79e5957742\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.172344 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.172326 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/256c8000-35f3-4859-a71d-8b79e5957742-test-realms\") pod \"maas-keycloak-0\" (UID: \"256c8000-35f3-4859-a71d-8b79e5957742\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.179973 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.179942 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4hrj\" (UniqueName: \"kubernetes.io/projected/256c8000-35f3-4859-a71d-8b79e5957742-kube-api-access-k4hrj\") pod \"maas-keycloak-0\" (UID: \"256c8000-35f3-4859-a71d-8b79e5957742\") " pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.333628 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.333583 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:49.357663 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.357630 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cabd7e5-eca0-4f4e-9f65-a39b61cc0050" path="/var/lib/kubelet/pods/0cabd7e5-eca0-4f4e-9f65-a39b61cc0050/volumes" Jun 06 20:33:49.373933 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.373902 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:33:49.374332 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.374287 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:33:49.375158 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.375136 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-bfrfb" Jun 06 20:33:49.472747 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.472709 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 06 20:33:49.475437 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:33:49.475409 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256c8000_35f3_4859_a71d_8b79e5957742.slice/crio-d8bed231db2cda114a95a5e4c712ce752a61168da4c42083fc68b93e36fa465d WatchSource:0}: Error finding container d8bed231db2cda114a95a5e4c712ce752a61168da4c42083fc68b93e36fa465d: Status 404 returned error can't find the container with id d8bed231db2cda114a95a5e4c712ce752a61168da4c42083fc68b93e36fa465d Jun 06 20:33:49.476676 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.476656 2537 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 20:33:49.978902 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.978857 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"256c8000-35f3-4859-a71d-8b79e5957742","Type":"ContainerStarted","Data":"c31eb3d52add00ec260fa7ddc7757b044b4e4d76ed1a27785898477869af116a"} Jun 06 20:33:49.979084 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:49.978927 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"256c8000-35f3-4859-a71d-8b79e5957742","Type":"ContainerStarted","Data":"d8bed231db2cda114a95a5e4c712ce752a61168da4c42083fc68b93e36fa465d"} Jun 06 20:33:50.002720 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:50.002667 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.707554747 podStartE2EDuration="1.002648894s" totalImagesPullingTime="295.094147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:33:50.00096946 +0000 UTC m=+851.077394629" watchObservedRunningTime="2026-06-06 20:33:50.002648894 +0000 UTC m=+851.079074053" Jun 06 20:33:50.334551 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:50.334506 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:50.335731 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:50.335699 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:51.335061 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:51.334988 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:52.334892 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:52.334840 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:53.334347 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:53.334291 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:54.334530 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:54.334475 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:55.335451 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:55.335395 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:56.335093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:56.335023 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:57.334919 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:57.334868 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:58.335140 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:58.335046 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:33:59.334636 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:59.334587 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 06 20:33:59.334965 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:33:59.334931 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:34:00.334473 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:00.334414 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:34:01.334278 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:01.334237 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:34:02.334864 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:02.334820 2537 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.35:9000/health/started\": dial tcp 10.134.0.35:9000: connect: connection refused" Jun 06 20:34:03.440414 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:03.440369 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 06 20:34:03.458861 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:03.458753 2537 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:34:13.446093 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:13.446035 2537 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="256c8000-35f3-4859-a71d-8b79e5957742" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 20:34:23.446901 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:23.446795 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 06 20:34:39.380697 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:39.380666 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:34:39.381157 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:39.380704 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:34:52.195719 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:52.195681 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:34:54.773892 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:34:54.773842 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:35:04.681728 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:04.681692 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:35:19.788007 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:19.787965 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:35:27.673830 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:27.673788 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:35:43.891228 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.891189 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6"] Jun 06 20:35:43.894630 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.894610 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:43.898157 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.898138 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mjf4j\"" Jun 06 20:35:43.898285 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.898193 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 06 20:35:43.898285 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.898221 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 06 20:35:43.898285 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.898233 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 06 20:35:43.904659 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:43.904640 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6"] Jun 06 20:35:44.012074 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.012029 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzwwh\" (UniqueName: \"kubernetes.io/projected/54d769b6-88b3-4381-9dde-10ca455894cf-kube-api-access-zzwwh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.012269 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.012088 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.012269 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.012180 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.012269 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.012207 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.012269 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.012228 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.012412 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.012293 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d769b6-88b3-4381-9dde-10ca455894cf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113065 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113024 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzwwh\" (UniqueName: \"kubernetes.io/projected/54d769b6-88b3-4381-9dde-10ca455894cf-kube-api-access-zzwwh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113065 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113073 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113317 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113142 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113317 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113170 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113317 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113199 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113317 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113255 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d769b6-88b3-4381-9dde-10ca455894cf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113618 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113591 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113737 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113654 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.113737 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.113685 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.115512 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.115491 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54d769b6-88b3-4381-9dde-10ca455894cf-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.115793 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.115773 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54d769b6-88b3-4381-9dde-10ca455894cf-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.121148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.121102 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzwwh\" (UniqueName: \"kubernetes.io/projected/54d769b6-88b3-4381-9dde-10ca455894cf-kube-api-access-zzwwh\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-4n2q6\" (UID: \"54d769b6-88b3-4381-9dde-10ca455894cf\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.204016 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.203930 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:44.336428 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.336384 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6"] Jun 06 20:35:44.338935 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:35:44.338906 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d769b6_88b3_4381_9dde_10ca455894cf.slice/crio-9f7ccabbd7f654a6b9ea74d9baa55c9fe390acff3c85c45e11a8498fd17eec52 WatchSource:0}: Error finding container 9f7ccabbd7f654a6b9ea74d9baa55c9fe390acff3c85c45e11a8498fd17eec52: Status 404 returned error can't find the container with id 9f7ccabbd7f654a6b9ea74d9baa55c9fe390acff3c85c45e11a8498fd17eec52 Jun 06 20:35:44.561500 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.561460 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" event={"ID":"54d769b6-88b3-4381-9dde-10ca455894cf","Type":"ContainerStarted","Data":"9f7ccabbd7f654a6b9ea74d9baa55c9fe390acff3c85c45e11a8498fd17eec52"} Jun 06 20:35:44.980522 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:44.980426 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:35:48.585983 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:48.585937 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" event={"ID":"54d769b6-88b3-4381-9dde-10ca455894cf","Type":"ContainerStarted","Data":"e472447f92a4388f84fbc3ca97b8b47e9b8d9d67c5c573c1e88c0cb71307d056"} Jun 06 20:35:49.592174 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:49.592134 2537 generic.go:356] "Generic (PLEG): container finished" podID="54d769b6-88b3-4381-9dde-10ca455894cf" containerID="e472447f92a4388f84fbc3ca97b8b47e9b8d9d67c5c573c1e88c0cb71307d056" exitCode=0 Jun 06 20:35:49.592615 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:49.592202 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" event={"ID":"54d769b6-88b3-4381-9dde-10ca455894cf","Type":"ContainerDied","Data":"e472447f92a4388f84fbc3ca97b8b47e9b8d9d67c5c573c1e88c0cb71307d056"} Jun 06 20:35:51.603391 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:51.603347 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" event={"ID":"54d769b6-88b3-4381-9dde-10ca455894cf","Type":"ContainerStarted","Data":"fc9750b6aa92ac299979530627b67e8035c01b7a63147bb343a929bafbcc8048"} Jun 06 20:35:51.621134 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:51.621067 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" podStartSLOduration=2.968656535 podStartE2EDuration="8.621050929s" totalImagesPullingTime="4.353041527s" totalInitContainerRuntime="1.299352867s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:35:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:35:51.620446672 +0000 UTC m=+972.696871812" watchObservedRunningTime="2026-06-06 20:35:51.621050929 +0000 UTC m=+972.697476067" Jun 06 20:35:54.204353 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:54.204315 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:54.204761 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:54.204389 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:54.217055 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:54.217031 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:35:54.633998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:35:54.633966 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-4n2q6" Jun 06 20:37:14.581102 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:37:14.581067 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:37:23.778896 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:37:23.778818 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:37:33.879592 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:37:33.879552 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:37:43.974950 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:37:43.974911 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:37:53.075828 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:37:53.075790 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:38:02.876215 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:38:02.876175 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:38:37.080770 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:38:37.080732 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:38:40.276828 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:38:40.276790 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:38:45.973795 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:38:45.973758 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:38:48.580018 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:38:48.579982 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:39:16.978101 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:39:16.978065 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:39:33.677064 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:39:33.677018 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:39:39.409591 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:39:39.409563 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:39:39.410526 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:39:39.410500 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:40:11.084449 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:40:11.084413 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:40:28.277952 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:40:28.277869 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:40:41.275474 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:40:41.275428 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:40:44.875586 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:40:44.875552 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:40:57.223451 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:40:57.223412 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:41:00.079286 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:41:00.079244 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:41:36.374862 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:41:36.374828 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:41:39.577443 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:41:39.577399 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:42:01.574764 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:42:01.574724 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:42:10.880283 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:42:10.880243 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:42:27.174330 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:42:27.174275 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:42:36.176836 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:42:36.176798 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:42:52.884084 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:42:52.884044 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:43:00.783534 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:43:00.783496 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:43:33.975597 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:43:33.975513 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:43:41.881534 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:43:41.881492 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:43:44.780185 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:43:44.780147 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:43:51.478847 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:43:51.478813 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:43:59.080970 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:43:59.080929 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:44:07.476815 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:07.476772 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:44:16.175641 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:16.175604 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:44:19.274249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:19.274217 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:44:24.583676 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:24.583636 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:44:36.478896 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:36.478856 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:44:39.437929 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:39.437896 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:44:39.440234 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:44:39.440212 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:45:13.172471 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:13.172429 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:15.470286 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:15.470253 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:23.479637 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:23.479595 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:27.376993 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:27.376957 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:34.979726 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:34.979688 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:42.384416 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:42.384374 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:52.283238 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:52.283198 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:45:59.984858 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:45:59.984824 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:09.178469 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:09.178433 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:12.881339 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:12.881300 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:17.786389 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:17.786351 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:27.580142 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:27.580025 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:35.376584 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:35.376548 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:45.277446 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:45.277409 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:46:52.883539 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:46:52.883502 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:47:02.682304 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:47:02.682266 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:47:10.681015 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:47:10.680971 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:47:19.676176 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:47:19.676138 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:47:26.882881 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:47:26.882839 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:47:37.276322 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:47:37.276283 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:47:45.078996 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:47:45.078949 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:49:39.466788 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:39.466758 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:49:39.470390 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:39.470355 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:49:43.055163 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.055120 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l"] Jun 06 20:49:43.058674 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.058652 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.061463 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.061441 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cc89s\"" Jun 06 20:49:43.070461 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.070433 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l"] Jun 06 20:49:43.248771 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.248720 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr2g8\" (UniqueName: \"kubernetes.io/projected/a9451645-54ad-4caa-b73e-733c7d718c35-kube-api-access-rr2g8\") pod \"kuadrant-operator-controller-manager-86878c769f-6t59l\" (UID: \"a9451645-54ad-4caa-b73e-733c7d718c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.248955 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.248889 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9451645-54ad-4caa-b73e-733c7d718c35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6t59l\" (UID: \"a9451645-54ad-4caa-b73e-733c7d718c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.349784 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.349697 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9451645-54ad-4caa-b73e-733c7d718c35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6t59l\" (UID: \"a9451645-54ad-4caa-b73e-733c7d718c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.349784 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.349750 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr2g8\" (UniqueName: \"kubernetes.io/projected/a9451645-54ad-4caa-b73e-733c7d718c35-kube-api-access-rr2g8\") pod \"kuadrant-operator-controller-manager-86878c769f-6t59l\" (UID: \"a9451645-54ad-4caa-b73e-733c7d718c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.350094 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.350074 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a9451645-54ad-4caa-b73e-733c7d718c35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6t59l\" (UID: \"a9451645-54ad-4caa-b73e-733c7d718c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.357986 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.357956 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr2g8\" (UniqueName: \"kubernetes.io/projected/a9451645-54ad-4caa-b73e-733c7d718c35-kube-api-access-rr2g8\") pod \"kuadrant-operator-controller-manager-86878c769f-6t59l\" (UID: \"a9451645-54ad-4caa-b73e-733c7d718c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.368998 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.368973 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:43.509850 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.509821 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l"] Jun 06 20:49:43.512620 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:49:43.512587 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9451645_54ad_4caa_b73e_733c7d718c35.slice/crio-eb0cbf708c484db20689034e97219851f30c5f683814e4ec4b94d98f6336f579 WatchSource:0}: Error finding container eb0cbf708c484db20689034e97219851f30c5f683814e4ec4b94d98f6336f579: Status 404 returned error can't find the container with id eb0cbf708c484db20689034e97219851f30c5f683814e4ec4b94d98f6336f579 Jun 06 20:49:43.534590 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:43.534565 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" event={"ID":"a9451645-54ad-4caa-b73e-733c7d718c35","Type":"ContainerStarted","Data":"eb0cbf708c484db20689034e97219851f30c5f683814e4ec4b94d98f6336f579"} Jun 06 20:49:44.541534 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:44.541497 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" event={"ID":"a9451645-54ad-4caa-b73e-733c7d718c35","Type":"ContainerStarted","Data":"6ab1969c7c3358b703d631984bb9ca41bd5f77aea61e87175bd64f9168d32826"} Jun 06 20:49:44.541921 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:44.541583 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:49:44.564959 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:44.564914 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" podStartSLOduration=1.5648977419999999 podStartE2EDuration="1.564897742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:49:44.562494136 +0000 UTC m=+1805.638919285" watchObservedRunningTime="2026-06-06 20:49:44.564897742 +0000 UTC m=+1805.641322881" Jun 06 20:49:55.549549 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:49:55.549517 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6t59l" Jun 06 20:50:03.987884 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:50:03.987848 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:50:07.992026 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:50:07.991989 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:50:34.091884 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:50:34.091843 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:50:38.587710 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:50:38.587669 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:50:48.388812 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:50:48.388773 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:50:57.493016 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:50:57.492978 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:51:07.486500 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:51:07.486462 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:51:17.588629 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:51:17.588591 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:51:26.289901 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:51:26.289860 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:51:36.185947 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:51:36.185906 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:51:45.490803 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:51:45.490765 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:51:56.491174 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:51:56.491128 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:52:04.785440 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:52:04.785400 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:52:07.489887 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:52:07.489851 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:52:38.287658 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:52:38.287571 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:53:20.896044 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:53:20.895995 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:53:29.786505 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:53:29.786467 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:53:38.186850 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:53:38.186811 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:53:47.088254 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:53:47.088218 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:53:55.296186 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:53:55.296086 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:06.183321 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:06.183281 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:14.698001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:14.697953 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:20.391646 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:20.391610 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:29.100001 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:29.099962 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:37.788303 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:37.788256 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:39.496678 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:39.496642 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:54:39.500494 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:39.500472 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:54:45.686912 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:45.686859 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:54:56.191160 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:54:56.191099 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:55:14.493533 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:55:14.493482 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:55:21.784457 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:55:21.784372 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:55:31.089742 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:55:31.089701 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:55:39.892799 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:55:39.892762 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:55:57.295283 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:55:57.295236 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:04.997415 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:04.997375 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:13.494020 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:13.493981 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:21.894131 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:21.894066 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:32.198884 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:32.198842 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:38.905791 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:38.905752 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:41.884348 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:41.884313 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:48.698097 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:48.698053 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:56:58.992767 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:56:58.992685 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:02.190074 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:02.190032 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:08.890378 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:08.890342 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:19.884384 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:19.884351 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:30.200754 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:30.200716 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:33.992568 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:33.992526 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:43.204302 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:43.204267 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:57:48.888708 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:57:48.888667 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:58:05.488145 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:58:05.488091 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:58:14.288893 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:58:14.288852 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:58:23.088569 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:58:23.088479 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:58:28.684194 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:58:28.684158 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:58:52.193778 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:58:52.193735 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:59:05.189265 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:05.189224 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vzkxm"] Jun 06 20:59:06.050535 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.050501 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7"] Jun 06 20:59:06.054410 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.054386 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.057040 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.057013 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ff2f80cc-openshift-default-dockercfg-hgdqj\"" Jun 06 20:59:06.073496 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.073468 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7"] Jun 06 20:59:06.113078 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113038 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-token\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113092 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-credential-socket\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113135 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-certs\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113174 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbx86\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-kube-api-access-vbx86\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113205 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329baf5-ff8e-425d-afe1-ee3a88d06522-istiod-ca-cert\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113245 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-envoy\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113259 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-data\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113467 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113279 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-socket\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.113467 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.113296 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-podinfo\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.213772 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.213734 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-token\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.213792 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-credential-socket\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.213815 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-certs\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.213851 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbx86\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-kube-api-access-vbx86\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.213900 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329baf5-ff8e-425d-afe1-ee3a88d06522-istiod-ca-cert\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.213956 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-envoy\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.214077 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-data\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.214164 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-socket\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214270 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.214197 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-podinfo\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214781 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.214398 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-credential-socket\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214781 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.214471 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-data\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.214781 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.214570 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-socket\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.216000 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.215968 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-certs\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.216220 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.216199 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329baf5-ff8e-425d-afe1-ee3a88d06522-istiod-ca-cert\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.216600 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.216575 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-envoy\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.217757 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.217735 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-podinfo\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.234883 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.234851 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-token\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.235066 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.235043 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbx86\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-kube-api-access-vbx86\") pod \"e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.365245 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.365153 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:06.502894 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.502863 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7"] Jun 06 20:59:06.505561 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:59:06.505533 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9329baf5_ff8e_425d_afe1_ee3a88d06522.slice/crio-a56c5d2290ca57aa3f02ed8da6cf13ddc4728c9f6dde40e1937df03af3337570 WatchSource:0}: Error finding container a56c5d2290ca57aa3f02ed8da6cf13ddc4728c9f6dde40e1937df03af3337570: Status 404 returned error can't find the container with id a56c5d2290ca57aa3f02ed8da6cf13ddc4728c9f6dde40e1937df03af3337570 Jun 06 20:59:06.507643 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.507608 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:59:06.507708 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.507679 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:59:06.507752 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:06.507706 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:59:07.294162 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:07.294097 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" event={"ID":"9329baf5-ff8e-425d-afe1-ee3a88d06522","Type":"ContainerStarted","Data":"bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200"} Jun 06 20:59:07.294525 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:07.294179 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" event={"ID":"9329baf5-ff8e-425d-afe1-ee3a88d06522","Type":"ContainerStarted","Data":"a56c5d2290ca57aa3f02ed8da6cf13ddc4728c9f6dde40e1937df03af3337570"} Jun 06 20:59:07.315316 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:07.315261 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" podStartSLOduration=1.315243929 podStartE2EDuration="1.315243929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:07.31317866 +0000 UTC m=+2368.389603798" watchObservedRunningTime="2026-06-06 20:59:07.315243929 +0000 UTC m=+2368.391669067" Jun 06 20:59:07.365512 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:07.365486 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:07.370448 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:07.370425 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:08.299595 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:08.299564 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:08.300606 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:08.300584 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:12.462185 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:12.462144 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7"] Jun 06 20:59:12.462727 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:12.462336 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" podUID="9329baf5-ff8e-425d-afe1-ee3a88d06522" containerName="istio-proxy" containerID="cri-o://bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200" gracePeriod=30 Jun 06 20:59:17.715646 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.715620 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:17.824017 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.823981 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-podinfo\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824026 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-credential-socket\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824081 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-token\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824097 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-data\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824158 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329baf5-ff8e-425d-afe1-ee3a88d06522-istiod-ca-cert\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824183 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-envoy\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824207 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-certs\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824249 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824238 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbx86\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-kube-api-access-vbx86\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824639 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824406 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:17.824639 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824547 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:17.824639 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824619 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-data" (OuterVolumeSpecName: "istio-data") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:17.824639 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824620 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-socket\") pod \"9329baf5-ff8e-425d-afe1-ee3a88d06522\" (UID: \"9329baf5-ff8e-425d-afe1-ee3a88d06522\") " Jun 06 20:59:17.824852 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824648 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9329baf5-ff8e-425d-afe1-ee3a88d06522-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:59:17.824852 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.824775 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:17.825052 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.825032 2537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-credential-socket\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.825133 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.825052 2537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-data\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.825133 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.825063 2537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9329baf5-ff8e-425d-afe1-ee3a88d06522-istiod-ca-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.825133 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.825071 2537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.825133 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.825079 2537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-workload-socket\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.826511 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.826484 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-token" (OuterVolumeSpecName: "istio-token") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:59:17.826628 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.826489 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 06 20:59:17.826790 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.826760 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:17.826889 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.826770 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-kube-api-access-vbx86" (OuterVolumeSpecName: "kube-api-access-vbx86") pod "9329baf5-ff8e-425d-afe1-ee3a88d06522" (UID: "9329baf5-ff8e-425d-afe1-ee3a88d06522"). InnerVolumeSpecName "kube-api-access-vbx86". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:59:17.926371 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.926332 2537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-envoy\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.926371 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.926365 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbx86\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-kube-api-access-vbx86\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.926371 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.926374 2537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-podinfo\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:17.926676 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:17.926384 2537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9329baf5-ff8e-425d-afe1-ee3a88d06522-istio-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:18.353674 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.353636 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk"] Jun 06 20:59:18.354081 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.354054 2537 generic.go:356] "Generic (PLEG): container finished" podID="9329baf5-ff8e-425d-afe1-ee3a88d06522" containerID="bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200" exitCode=0 Jun 06 20:59:18.354239 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.354182 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" Jun 06 20:59:18.354311 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.354240 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9329baf5-ff8e-425d-afe1-ee3a88d06522" containerName="istio-proxy" Jun 06 20:59:18.354311 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.354259 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="9329baf5-ff8e-425d-afe1-ee3a88d06522" containerName="istio-proxy" Jun 06 20:59:18.354561 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.354535 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="9329baf5-ff8e-425d-afe1-ee3a88d06522" containerName="istio-proxy" Jun 06 20:59:18.357726 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.357701 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" event={"ID":"9329baf5-ff8e-425d-afe1-ee3a88d06522","Type":"ContainerDied","Data":"bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200"} Jun 06 20:59:18.357868 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.357744 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7" event={"ID":"9329baf5-ff8e-425d-afe1-ee3a88d06522","Type":"ContainerDied","Data":"a56c5d2290ca57aa3f02ed8da6cf13ddc4728c9f6dde40e1937df03af3337570"} Jun 06 20:59:18.357868 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.357775 2537 scope.go:117] "RemoveContainer" containerID="bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200" Jun 06 20:59:18.357868 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.357840 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.361544 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.361520 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-38ce0dc5-openshift-default-dockercfg-98749\"" Jun 06 20:59:18.370505 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.370180 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk"] Jun 06 20:59:18.372248 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.372226 2537 scope.go:117] "RemoveContainer" containerID="bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200" Jun 06 20:59:18.372669 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:59:18.372636 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200\": container with ID starting with bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200 not found: ID does not exist" containerID="bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200" Jun 06 20:59:18.372873 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.372677 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200"} err="failed to get container status \"bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200\": rpc error: code = NotFound desc = could not find container \"bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200\": container with ID starting with bb9916eb0994aa07ed1ddab694a97c03f7a4eda20bb2414c5806bf059c14b200 not found: ID does not exist" Jun 06 20:59:18.394355 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.394324 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7"] Jun 06 20:59:18.404261 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.404236 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ff2f80cc-openshift-default-559b7c7d8b-ksfq7"] Jun 06 20:59:18.432022 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.431989 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-credential-socket\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432184 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432145 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-socket\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432184 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432173 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-data\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432268 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432195 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-podinfo\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432268 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432241 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-envoy\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432369 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432274 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-certs\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432369 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432329 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-token\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432471 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432439 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc5m5\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-kube-api-access-zc5m5\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.432526 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.432493 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istiod-ca-cert\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.533978 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.533940 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-credential-socket\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534020 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-socket\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534044 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-data\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534062 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-podinfo\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534079 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-envoy\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534096 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-certs\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534148 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534135 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-token\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534509 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534311 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc5m5\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-kube-api-access-zc5m5\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.534509 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.534374 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istiod-ca-cert\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.535189 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.535163 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-credential-socket\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.535291 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.535200 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-socket\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.535291 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.535232 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-data\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.535396 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.535305 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-certs\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.535678 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.535654 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istiod-ca-cert\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.536521 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.536498 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-envoy\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.537268 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.537248 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-podinfo\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.544483 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.544456 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-token\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.544625 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.544460 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc5m5\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-kube-api-access-zc5m5\") pod \"e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.676285 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.676189 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:18.816907 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.816881 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk"] Jun 06 20:59:18.819264 ip-10-0-131-27 kubenswrapper[2537]: W0606 20:59:18.819235 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1956f3_45dd_4285_8b5c_e8adffdd94f5.slice/crio-46494dc5e6428d7a90a54b8313c9b16d702903dd882ffce2de24cb272e1292b4 WatchSource:0}: Error finding container 46494dc5e6428d7a90a54b8313c9b16d702903dd882ffce2de24cb272e1292b4: Status 404 returned error can't find the container with id 46494dc5e6428d7a90a54b8313c9b16d702903dd882ffce2de24cb272e1292b4 Jun 06 20:59:18.821376 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.821342 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:59:18.821487 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.821406 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:59:18.821487 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:18.821435 2537 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 20:59:19.359349 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:19.359317 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9329baf5-ff8e-425d-afe1-ee3a88d06522" path="/var/lib/kubelet/pods/9329baf5-ff8e-425d-afe1-ee3a88d06522/volumes" Jun 06 20:59:19.361002 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:19.360973 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" event={"ID":"5f1956f3-45dd-4285-8b5c-e8adffdd94f5","Type":"ContainerStarted","Data":"10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3"} Jun 06 20:59:19.361199 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:19.361036 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" event={"ID":"5f1956f3-45dd-4285-8b5c-e8adffdd94f5","Type":"ContainerStarted","Data":"46494dc5e6428d7a90a54b8313c9b16d702903dd882ffce2de24cb272e1292b4"} Jun 06 20:59:19.382859 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:19.382801 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" podStartSLOduration=1.3827852680000001 podStartE2EDuration="1.382785268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 20:59:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 20:59:19.380299409 +0000 UTC m=+2380.456724583" watchObservedRunningTime="2026-06-06 20:59:19.382785268 +0000 UTC m=+2380.459210518" Jun 06 20:59:19.676807 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:19.676717 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:19.681523 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:19.681497 2537 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:20.367951 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:20.367918 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:20.368803 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:20.368780 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:25.828285 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:25.828250 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk"] Jun 06 20:59:25.828679 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:25.828512 2537 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" podUID="5f1956f3-45dd-4285-8b5c-e8adffdd94f5" containerName="istio-proxy" containerID="cri-o://10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3" gracePeriod=30 Jun 06 20:59:31.085626 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.085565 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:31.256031 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.255989 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istiod-ca-cert\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256245 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256060 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-socket\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256245 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256139 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc5m5\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-kube-api-access-zc5m5\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256245 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256170 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-envoy\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256245 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256191 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-certs\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256253 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-podinfo\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256280 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-credential-socket\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256302 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-data\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256337 2537 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-token\") pod \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\" (UID: \"5f1956f3-45dd-4285-8b5c-e8adffdd94f5\") " Jun 06 20:59:31.256438 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256362 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:31.256605 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256509 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 20:59:31.256645 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256633 2537 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istiod-ca-cert\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.256679 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.256645 2537 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-socket\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.258384 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.258353 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:31.258384 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.258368 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:31.258384 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.258382 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:31.260353 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.260323 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:59:31.260452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.260369 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-kube-api-access-zc5m5" (OuterVolumeSpecName: "kube-api-access-zc5m5") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "kube-api-access-zc5m5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 20:59:31.260452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.260373 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 20:59:31.260452 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.260410 2537 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f1956f3-45dd-4285-8b5c-e8adffdd94f5" (UID: "5f1956f3-45dd-4285-8b5c-e8adffdd94f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.357976 2537 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-token\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.358002 2537 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc5m5\" (UniqueName: \"kubernetes.io/projected/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-kube-api-access-zc5m5\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.358013 2537 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-envoy\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.358024 2537 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-workload-certs\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.358033 2537 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-podinfo\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.358041 2537 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-credential-socket\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.358072 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.358049 2537 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f1956f3-45dd-4285-8b5c-e8adffdd94f5-istio-data\") on node \"ip-10-0-131-27.ec2.internal\" DevicePath \"\"" Jun 06 20:59:31.422020 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.421982 2537 generic.go:356] "Generic (PLEG): container finished" podID="5f1956f3-45dd-4285-8b5c-e8adffdd94f5" containerID="10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3" exitCode=0 Jun 06 20:59:31.422212 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.422051 2537 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" Jun 06 20:59:31.422212 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.422061 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" event={"ID":"5f1956f3-45dd-4285-8b5c-e8adffdd94f5","Type":"ContainerDied","Data":"10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3"} Jun 06 20:59:31.422212 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.422159 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk" event={"ID":"5f1956f3-45dd-4285-8b5c-e8adffdd94f5","Type":"ContainerDied","Data":"46494dc5e6428d7a90a54b8313c9b16d702903dd882ffce2de24cb272e1292b4"} Jun 06 20:59:31.422212 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.422184 2537 scope.go:117] "RemoveContainer" containerID="10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3" Jun 06 20:59:31.430971 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.430953 2537 scope.go:117] "RemoveContainer" containerID="10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3" Jun 06 20:59:31.431293 ip-10-0-131-27 kubenswrapper[2537]: E0606 20:59:31.431272 2537 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3\": container with ID starting with 10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3 not found: ID does not exist" containerID="10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3" Jun 06 20:59:31.431348 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.431301 2537 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3"} err="failed to get container status \"10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3\": rpc error: code = NotFound desc = could not find container \"10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3\": container with ID starting with 10993b6c42c4052209d8490681722f12c2a0659a783bbc6dcc52f540b3d8f4e3 not found: ID does not exist" Jun 06 20:59:31.437819 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.437794 2537 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk"] Jun 06 20:59:31.443398 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:31.443370 2537 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-38ce0dc5-openshift-default-86f7d77d8-5lcvk"] Jun 06 20:59:33.360712 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:33.360675 2537 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1956f3-45dd-4285-8b5c-e8adffdd94f5" path="/var/lib/kubelet/pods/5f1956f3-45dd-4285-8b5c-e8adffdd94f5/volumes" Jun 06 20:59:39.526557 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:39.526530 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:59:39.532737 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:39.532712 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7bh7_09ea38f0-90ad-4fc1-b42c-6e06c89766c8/ovn-acl-logging/0.log" Jun 06 20:59:43.530119 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:43.530088 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c6d865764-hcbgv_48aa8c47-b9c4-4619-94d7-601f69a0595c/nginx/0.log" Jun 06 20:59:44.797540 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:44.797507 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-wkl6j_1f8a4f78-cc2c-454d-9e04-2425b34f5f66/copy-manifests/0.log" Jun 06 20:59:44.809634 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:44.809606 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-wkl6j_1f8a4f78-cc2c-454d-9e04-2425b34f5f66/manager/0.log" Jun 06 20:59:46.388904 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:46.388869 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mwkgv_a313fc9e-0a7f-4819-b9d3-8afa6df23566/manager/0.log" Jun 06 20:59:46.732026 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:46.731952 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xg4z5_62da0aff-ec99-48a6-a414-4d27bb902232/registry-server/0.log" Jun 06 20:59:46.848556 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:46.848526 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6t59l_a9451645-54ad-4caa-b73e-733c7d718c35/manager/0.log" Jun 06 20:59:46.964864 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:46.964829 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vzkxm_dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7/limitador/0.log" Jun 06 20:59:47.077814 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:47.077785 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bh222_9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963/manager/0.log" Jun 06 20:59:47.410780 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:47.410697 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k7snf_05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f/istio-proxy/0.log" Jun 06 20:59:47.882761 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:47.882731 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/1.log" Jun 06 20:59:48.231238 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:48.231152 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c897769c-tszxg_8da29d36-fca5-4625-8ce6-ef7fdfb7cfec/router/0.log" Jun 06 20:59:49.150075 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:49.150042 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-4n2q6_54d769b6-88b3-4381-9dde-10ca455894cf/storage-initializer/0.log" Jun 06 20:59:49.157134 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:49.157099 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-4n2q6_54d769b6-88b3-4381-9dde-10ca455894cf/main/0.log" Jun 06 20:59:55.727184 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:55.727092 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zrs27_87adf520-cf72-441c-8d54-cd790aec6250/global-pull-secret-syncer/0.log" Jun 06 20:59:55.839856 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:55.839828 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vkfjh_f8e2c0d0-8320-461e-a1fc-f72a2fa8c185/konnectivity-agent/0.log" Jun 06 20:59:55.883604 ip-10-0-131-27 kubenswrapper[2537]: I0606 20:59:55.883577 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-27.ec2.internal_8d514af871cbc9d3423e5820a3b7b5aa/haproxy/0.log" Jun 06 21:00:01.244666 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:01.244610 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mwkgv_a313fc9e-0a7f-4819-b9d3-8afa6df23566/manager/0.log" Jun 06 21:00:01.348399 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:01.348368 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xg4z5_62da0aff-ec99-48a6-a414-4d27bb902232/registry-server/0.log" Jun 06 21:00:01.401274 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:01.401241 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6t59l_a9451645-54ad-4caa-b73e-733c7d718c35/manager/0.log" Jun 06 21:00:01.423329 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:01.423303 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vzkxm_dcb51ddc-9a7f-44ac-a6fa-8a4b79f57ae7/limitador/0.log" Jun 06 21:00:01.485399 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:01.485366 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bh222_9a18f12a-f4e4-4b66-b3c3-ac3e6c11b963/manager/0.log" Jun 06 21:00:03.217545 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.217514 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-75vqp_2c037ed1-5959-4514-b26a-04d5df3dbd42/monitoring-plugin/0.log" Jun 06 21:00:03.441056 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.441022 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z85wm_1749912d-7010-41c3-bb6c-5e5e59590efc/node-exporter/0.log" Jun 06 21:00:03.464550 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.464515 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z85wm_1749912d-7010-41c3-bb6c-5e5e59590efc/kube-rbac-proxy/0.log" Jun 06 21:00:03.487187 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.487159 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z85wm_1749912d-7010-41c3-bb6c-5e5e59590efc/init-textfile/0.log" Jun 06 21:00:03.608354 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.608330 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/prometheus/0.log" Jun 06 21:00:03.631583 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.631558 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/config-reloader/0.log" Jun 06 21:00:03.660177 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.660151 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/thanos-sidecar/0.log" Jun 06 21:00:03.680508 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.680484 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/kube-rbac-proxy-web/0.log" Jun 06 21:00:03.707462 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.707436 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/kube-rbac-proxy/0.log" Jun 06 21:00:03.742386 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.742360 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/kube-rbac-proxy-thanos/0.log" Jun 06 21:00:03.766871 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.766823 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7084be06-f82e-47ed-9ce5-a508d895df23/init-config-reloader/0.log" Jun 06 21:00:03.795954 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.795925 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wkn82_41cdd166-fb00-47c5-bba0-edb7ce9859a2/prometheus-operator/0.log" Jun 06 21:00:03.816252 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.816226 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-wkn82_41cdd166-fb00-47c5-bba0-edb7ce9859a2/kube-rbac-proxy/0.log" Jun 06 21:00:03.964297 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.964262 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/thanos-query/0.log" Jun 06 21:00:03.983703 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:03.983673 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy-web/0.log" Jun 06 21:00:04.002903 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:04.002878 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy/0.log" Jun 06 21:00:04.024264 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:04.024237 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/prom-label-proxy/0.log" Jun 06 21:00:04.045641 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:04.045610 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy-rules/0.log" Jun 06 21:00:04.067186 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:04.067155 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-76d7854648-sldr8_6faa1e6b-9a1b-4840-9391-eba508d9e9e7/kube-rbac-proxy-metrics/0.log" Jun 06 21:00:07.380306 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.380281 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-l6n7n_6357fb1d-8800-494c-98d6-057a4652fbb2/volume-data-source-validator/0.log" Jun 06 21:00:07.554341 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.554304 2537 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg"] Jun 06 21:00:07.554846 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.554824 2537 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1956f3-45dd-4285-8b5c-e8adffdd94f5" containerName="istio-proxy" Jun 06 21:00:07.554904 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.554849 2537 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1956f3-45dd-4285-8b5c-e8adffdd94f5" containerName="istio-proxy" Jun 06 21:00:07.554960 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.554948 2537 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1956f3-45dd-4285-8b5c-e8adffdd94f5" containerName="istio-proxy" Jun 06 21:00:07.558087 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.558065 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.560609 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.560588 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcg66\"/\"kube-root-ca.crt\"" Jun 06 21:00:07.560814 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.560788 2537 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mcg66\"/\"openshift-service-ca.crt\"" Jun 06 21:00:07.562031 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.561996 2537 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mcg66\"/\"default-dockercfg-9fdhk\"" Jun 06 21:00:07.564084 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.564061 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg"] Jun 06 21:00:07.674409 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.674322 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-lib-modules\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.674409 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.674382 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-sys\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.674604 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.674410 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx5hd\" (UniqueName: \"kubernetes.io/projected/960a9150-91db-4582-b1b1-7b81df1a0f35-kube-api-access-dx5hd\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.674604 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.674463 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-podres\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.674604 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.674519 2537 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-proc\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.775951 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.775910 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-podres\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.775951 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.775953 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-proc\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776224 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.775974 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-lib-modules\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776224 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.776020 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-sys\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776224 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.776038 2537 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx5hd\" (UniqueName: \"kubernetes.io/projected/960a9150-91db-4582-b1b1-7b81df1a0f35-kube-api-access-dx5hd\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776224 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.776062 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-proc\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776224 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.776101 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-podres\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776224 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.776199 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-lib-modules\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.776500 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.776237 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/960a9150-91db-4582-b1b1-7b81df1a0f35-sys\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.784491 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.784464 2537 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx5hd\" (UniqueName: \"kubernetes.io/projected/960a9150-91db-4582-b1b1-7b81df1a0f35-kube-api-access-dx5hd\") pod \"perf-node-gather-daemonset-rqjhg\" (UID: \"960a9150-91db-4582-b1b1-7b81df1a0f35\") " pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:07.869518 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:07.869478 2537 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:08.002704 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.002654 2537 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg"] Jun 06 21:00:08.005365 ip-10-0-131-27 kubenswrapper[2537]: W0606 21:00:08.005340 2537 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod960a9150_91db_4582_b1b1_7b81df1a0f35.slice/crio-498f93d82c410b8da92793b6f5f700684b9ec89215b02529e90002f0d1e1df92 WatchSource:0}: Error finding container 498f93d82c410b8da92793b6f5f700684b9ec89215b02529e90002f0d1e1df92: Status 404 returned error can't find the container with id 498f93d82c410b8da92793b6f5f700684b9ec89215b02529e90002f0d1e1df92 Jun 06 21:00:08.592060 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.592036 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7crdx_cf504e7d-2b68-4404-96cb-3148b414abfb/dns/0.log" Jun 06 21:00:08.599420 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.599391 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" event={"ID":"960a9150-91db-4582-b1b1-7b81df1a0f35","Type":"ContainerStarted","Data":"54c15eb32670492025253f55c68082d08c615472adf63d8da3ffc9c7e0a50fed"} Jun 06 21:00:08.599580 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.599438 2537 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" event={"ID":"960a9150-91db-4582-b1b1-7b81df1a0f35","Type":"ContainerStarted","Data":"498f93d82c410b8da92793b6f5f700684b9ec89215b02529e90002f0d1e1df92"} Jun 06 21:00:08.599580 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.599522 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:08.614747 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.614696 2537 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" podStartSLOduration=1.614682641 podStartE2EDuration="1.614682641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 21:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 21:00:08.613933869 +0000 UTC m=+2429.690359007" watchObservedRunningTime="2026-06-06 21:00:08.614682641 +0000 UTC m=+2429.691107780" Jun 06 21:00:08.616022 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.616001 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7crdx_cf504e7d-2b68-4404-96cb-3148b414abfb/kube-rbac-proxy/0.log" Jun 06 21:00:08.753532 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:08.753507 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4dpkw_73187db6-5446-4b72-a0b3-ff3be6af2eb8/dns-node-resolver/0.log" Jun 06 21:00:09.352310 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:09.352265 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6x4q_f298a496-2968-4d0d-8026-0e39b5759b44/node-ca/0.log" Jun 06 21:00:10.272019 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:10.271969 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k7snf_05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f/istio-proxy/0.log" Jun 06 21:00:10.449922 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:10.449893 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/0.log" Jun 06 21:00:10.479781 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:10.479751 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/1.log" Jun 06 21:00:10.632427 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:10.632341 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c897769c-tszxg_8da29d36-fca5-4625-8ce6-ef7fdfb7cfec/router/0.log" Jun 06 21:00:11.252340 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:11.252306 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ktlcq_d9fa04f6-dea5-4f93-bc17-bd260da5d3ed/serve-healthcheck-canary/0.log" Jun 06 21:00:11.772370 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:11.772340 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pvglm_39d1df18-2baf-46e9-a234-9c129f9b35f7/insights-operator/0.log" Jun 06 21:00:11.774347 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:11.774326 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-pvglm_39d1df18-2baf-46e9-a234-9c129f9b35f7/insights-operator/1.log" Jun 06 21:00:11.794244 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:11.794215 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xv2x_978e2523-6ab4-47b7-8b5f-a4ec6586d825/kube-rbac-proxy/0.log" Jun 06 21:00:11.813179 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:11.813156 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xv2x_978e2523-6ab4-47b7-8b5f-a4ec6586d825/exporter/0.log" Jun 06 21:00:11.832266 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:11.832236 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xv2x_978e2523-6ab4-47b7-8b5f-a4ec6586d825/extractor/0.log" Jun 06 21:00:14.136385 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:14.136357 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7c6d865764-hcbgv_48aa8c47-b9c4-4619-94d7-601f69a0595c/nginx/0.log" Jun 06 21:00:14.614013 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:14.613989 2537 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mcg66/perf-node-gather-daemonset-rqjhg" Jun 06 21:00:14.776029 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:14.775991 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-wkl6j_1f8a4f78-cc2c-454d-9e04-2425b34f5f66/manager/0.log" Jun 06 21:00:14.791216 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:14.791192 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6757f99dd5-wkl6j_1f8a4f78-cc2c-454d-9e04-2425b34f5f66/copy-manifests/0.log" Jun 06 21:00:16.397878 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:16.397771 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-844cc775f9-cps29_2060cd7b-c271-48dc-beac-c8cba42becf1/manager/0.log" Jun 06 21:00:19.928451 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:19.928419 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k7snf_05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f/istio-proxy/0.log" Jun 06 21:00:20.074390 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:20.074355 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/0.log" Jun 06 21:00:20.103454 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:20.103416 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/1.log" Jun 06 21:00:20.233912 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:20.233885 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c897769c-tszxg_8da29d36-fca5-4625-8ce6-ef7fdfb7cfec/router/0.log" Jun 06 21:00:21.284879 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:21.284846 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k7snf_05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f/istio-proxy/0.log" Jun 06 21:00:21.460890 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:21.460864 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/0.log" Jun 06 21:00:21.491464 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:21.491433 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/1.log" Jun 06 21:00:21.624295 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:21.624220 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c897769c-tszxg_8da29d36-fca5-4625-8ce6-ef7fdfb7cfec/router/0.log" Jun 06 21:00:21.740264 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:21.740233 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-tmkdw_577212de-59f8-4ce9-a529-c8e4535eb4c9/migrator/0.log" Jun 06 21:00:21.759919 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:21.759894 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-tmkdw_577212de-59f8-4ce9-a529-c8e4535eb4c9/graceful-termination/0.log" Jun 06 21:00:23.276857 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.276829 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k7snf_05aa8e4b-eb3b-432b-9b1d-bd55c2aa8e9f/istio-proxy/0.log" Jun 06 21:00:23.416548 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.416514 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/0.log" Jun 06 21:00:23.419130 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.419094 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/kube-multus-additional-cni-plugins/0.log" Jun 06 21:00:23.440962 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.440933 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/egress-router-binary-copy/0.log" Jun 06 21:00:23.451092 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.451064 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-bfrfb_4d3f409f-5dc1-45b9-a1e4-b41dc5bb89a2/istio-proxy/1.log" Jun 06 21:00:23.462675 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.462650 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/cni-plugins/0.log" Jun 06 21:00:23.482162 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.482088 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/bond-cni-plugin/0.log" Jun 06 21:00:23.502365 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.502339 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/routeoverride-cni/0.log" Jun 06 21:00:23.526038 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.526007 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/whereabouts-cni-bincopy/0.log" Jun 06 21:00:23.547544 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.547518 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8h9vg_59fe2e4c-5d5b-4e25-a1cc-b21db8e56047/whereabouts-cni/0.log" Jun 06 21:00:23.582068 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.582044 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75c897769c-tszxg_8da29d36-fca5-4625-8ce6-ef7fdfb7cfec/router/0.log" Jun 06 21:00:23.748543 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.748482 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p994s_e81bbe4b-afdc-40f2-9874-5f2784bfb322/kube-multus/0.log" Jun 06 21:00:23.862039 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.862008 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sgvqq_45defa4b-0edc-4a3f-947f-6c25f55df3f8/network-metrics-daemon/0.log" Jun 06 21:00:23.885032 ip-10-0-131-27 kubenswrapper[2537]: I0606 21:00:23.885008 2537 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sgvqq_45defa4b-0edc-4a3f-947f-6c25f55df3f8/kube-rbac-proxy/0.log"