Jun 05 13:24:20.947288 ip-10-0-142-213 systemd[1]: Starting Kubernetes Kubelet... Jun 05 13:24:21.304015 ip-10-0-142-213 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:24:21.304015 ip-10-0-142-213 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 13:24:21.304015 ip-10-0-142-213 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:24:21.304015 ip-10-0-142-213 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 13:24:21.304015 ip-10-0-142-213 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 13:24:21.305148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.304952 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 13:24:21.309718 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309702 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:21.309718 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309717 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309721 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309726 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309729 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309732 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309736 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309738 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309742 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309745 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309748 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309750 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309753 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309755 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309758 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309760 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309763 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309765 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309768 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309771 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309774 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:21.309788 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309776 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309779 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309781 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309785 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309788 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309791 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309794 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309799 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309803 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309806 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309809 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309812 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309814 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309817 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309819 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309822 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309825 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309827 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309830 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:21.310283 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309832 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309835 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309837 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309840 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309842 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309845 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309847 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309851 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309854 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309857 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309860 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309863 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309866 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309869 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309872 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309875 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309878 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309881 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309884 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:21.310734 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309887 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309889 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309892 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309895 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309898 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309900 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309904 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309906 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309909 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309911 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309914 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309916 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309919 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309921 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309924 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309927 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309930 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309932 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309935 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309937 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:21.311212 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309940 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309942 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309945 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309947 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309950 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309952 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309955 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309957 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309961 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309964 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309967 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309969 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309972 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309975 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309977 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309980 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309982 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309985 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309987 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.309990 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:21.311727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310663 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310669 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310672 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310675 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310678 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310680 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310683 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310686 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310688 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310691 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310694 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310697 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310699 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310704 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310708 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310711 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310714 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310717 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310720 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310723 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:21.312224 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310727 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310730 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310733 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310737 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310740 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310744 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310747 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310749 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310752 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310755 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310758 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310761 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310764 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310766 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310769 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310771 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310774 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310776 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310779 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:21.312762 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310781 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310784 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310786 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310789 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310792 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310794 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310797 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310800 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310802 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310805 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310807 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310810 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310813 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310816 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310819 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310822 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310825 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310828 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:21.313248 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310834 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310837 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310841 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310843 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310846 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310849 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310851 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310855 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310857 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310860 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310863 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310865 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310868 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310870 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310873 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310875 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310878 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310881 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310884 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310886 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:21.313758 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310889 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310891 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310894 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310896 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310899 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310901 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310905 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310907 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310910 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310912 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310915 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310917 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310920 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310922 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310925 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310927 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310930 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310932 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310935 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310937 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:21.314276 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.310940 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311298 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311303 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311306 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311309 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311311 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311314 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311317 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311320 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311323 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311327 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311329 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311332 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311335 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311337 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311340 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311343 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311346 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311349 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311351 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:21.314760 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311354 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311356 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311359 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311362 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311365 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311367 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311370 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311373 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311375 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311378 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311380 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311383 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311386 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311388 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311392 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311396 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311400 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311402 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311405 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:21.315254 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311408 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311411 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311413 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311417 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311419 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311422 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311425 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311427 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311430 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311432 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311435 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311438 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311440 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311445 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311448 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311451 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311454 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311457 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311460 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311462 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:21.315721 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311465 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311467 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311470 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311473 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311476 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311478 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311481 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311483 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311486 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311489 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311491 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311494 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311496 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311499 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311501 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311504 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311507 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311510 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311513 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311515 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:21.316257 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311518 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311520 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311523 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311526 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311528 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311531 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311533 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311536 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311538 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311541 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311543 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311546 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311548 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311551 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311554 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311556 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311559 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311561 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311563 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311566 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:21.316747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.311569 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311634 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311640 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311645 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311650 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311654 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311657 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311660 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311664 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311668 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311671 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311674 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311678 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311681 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311687 2565 flags.go:64] FLAG: --cgroup-root="" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311690 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311693 2565 flags.go:64] FLAG: --client-ca-file="" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311696 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311699 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311704 2565 flags.go:64] FLAG: --cluster-domain="" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311707 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311710 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311713 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311716 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 13:24:21.317313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311720 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311723 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311726 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311729 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311732 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311735 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311738 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311741 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311747 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311750 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311753 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311756 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311759 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311762 2565 flags.go:64] FLAG: --enable-server="true" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311765 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311769 2565 flags.go:64] FLAG: --event-burst="100" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311772 2565 flags.go:64] FLAG: --event-qps="50" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311775 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311778 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311781 2565 flags.go:64] FLAG: --eviction-hard="" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311784 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311787 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311791 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311794 2565 flags.go:64] FLAG: --eviction-soft="" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311797 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 13:24:21.317900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311800 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311803 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311805 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311808 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311811 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311814 2565 flags.go:64] FLAG: --feature-gates="" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311817 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311820 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311823 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311826 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311829 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311832 2565 flags.go:64] FLAG: --help="false" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311834 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311837 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311840 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311844 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311848 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311851 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311854 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311856 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311859 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311862 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311865 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311868 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 13:24:21.318572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311871 2565 flags.go:64] FLAG: --kube-reserved="" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311874 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311877 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311880 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311883 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311887 2565 flags.go:64] FLAG: --lock-file="" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311889 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311892 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311895 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311900 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311903 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311906 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311909 2565 flags.go:64] FLAG: --logging-format="text" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311911 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311915 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311917 2565 flags.go:64] FLAG: --manifest-url="" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311920 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311924 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311927 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311931 2565 flags.go:64] FLAG: --max-pods="110" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311933 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311936 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311939 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311943 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311946 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 13:24:21.319190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311949 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311952 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311959 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311962 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311964 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311967 2565 flags.go:64] FLAG: --pod-cidr="" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311970 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311975 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311978 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311981 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311984 2565 flags.go:64] FLAG: --port="10250" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311988 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311990 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-098f0186b79014db1" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311996 2565 flags.go:64] FLAG: --qos-reserved="" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.311999 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312001 2565 flags.go:64] FLAG: --register-node="true" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312004 2565 flags.go:64] FLAG: --register-with-taints="" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312008 2565 flags.go:64] FLAG: --registry-burst="10" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312011 2565 flags.go:64] FLAG: --registry-qps="5" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312013 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312016 2565 flags.go:64] FLAG: --reserved-memory="" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312020 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312023 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312026 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312029 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 13:24:21.319803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312032 2565 flags.go:64] FLAG: --runonce="false" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312049 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312055 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312059 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312062 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312066 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312068 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312072 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312075 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312077 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312080 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312083 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312086 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312089 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312091 2565 flags.go:64] FLAG: --system-cgroups="" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312095 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312100 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312103 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312106 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312110 2565 flags.go:64] FLAG: --tls-min-version="" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312115 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312117 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312120 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312123 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312126 2565 flags.go:64] FLAG: --v="2" Jun 05 13:24:21.320436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312129 2565 flags.go:64] FLAG: --version="false" Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312133 2565 flags.go:64] FLAG: --vmodule="" Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312137 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.312140 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312243 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312247 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312250 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312252 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312256 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312258 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312261 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312264 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312268 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312270 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312273 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312275 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312278 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312280 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312283 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312285 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:21.321091 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312288 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312290 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312293 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312295 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312298 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312301 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312304 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312309 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312313 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312318 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312321 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312324 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312327 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312330 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312332 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312335 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312338 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312341 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312344 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:21.321590 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312346 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312349 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312351 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312354 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312357 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312361 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312363 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312366 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312368 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312371 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312373 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312376 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312378 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312381 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312384 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312386 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312389 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312391 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312394 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312396 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:21.322068 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312401 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312404 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312406 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312409 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312411 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312414 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312417 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312419 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312422 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312424 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312427 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312429 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312432 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312435 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312437 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312440 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312443 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312448 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312451 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:21.322557 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312453 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312456 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312458 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312461 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312464 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312466 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312469 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312471 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312474 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312476 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312479 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312481 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312484 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312488 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312491 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312494 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312496 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312499 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312502 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312504 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:21.323028 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312507 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312509 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312512 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312514 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.312517 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.313321 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.319895 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.319908 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.320662 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.320669 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320728 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320734 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320738 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320741 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320744 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:21.323524 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320747 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320750 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320753 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320756 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320759 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320761 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320764 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320766 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320769 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320771 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320774 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320778 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320782 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320786 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320790 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320794 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320797 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320799 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320802 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320804 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:21.323919 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320807 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320809 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320812 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320814 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320819 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320822 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320824 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320827 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320829 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320832 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320836 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320839 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320843 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320846 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320849 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320852 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320855 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320858 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320863 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320867 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:21.324412 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320872 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320876 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320879 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320882 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320885 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320888 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320890 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320893 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320897 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320901 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320903 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320906 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320909 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320911 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320915 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320918 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320922 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320925 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320928 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:21.324888 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320931 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320934 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320937 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320940 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320944 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320948 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320953 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320956 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320959 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320961 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320964 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320967 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320969 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320971 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320974 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320976 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320979 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320982 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320985 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320987 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:21.325410 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320990 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320992 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320995 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.320997 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321000 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321003 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321005 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321008 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321011 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321013 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321016 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321020 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321024 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321028 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321032 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:21.325885 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.321049 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321173 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321179 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321183 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321188 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321192 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321196 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321200 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321203 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321206 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321209 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321213 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321216 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321219 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321221 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321224 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321227 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321229 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 13:24:21.326292 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321232 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321234 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321237 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321239 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321242 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321244 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321247 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321249 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321251 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321254 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321257 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321260 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321262 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321265 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321290 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321294 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321297 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321299 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321302 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321305 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 13:24:21.326727 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321308 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321310 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321313 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321315 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321318 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321320 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321323 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321325 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321327 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321330 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321333 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321335 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321338 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321340 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321343 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321347 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321351 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321354 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321359 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321362 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 13:24:21.327214 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321366 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321369 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321372 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321374 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321377 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321380 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321382 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321385 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321388 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321390 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321393 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321395 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321398 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321400 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321403 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321405 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321408 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321410 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321413 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321415 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 13:24:21.327729 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321418 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321420 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321423 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321425 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321429 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321433 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321437 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321441 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321445 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321448 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321451 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321453 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321456 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321459 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321462 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321465 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321468 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321471 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321474 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321477 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 13:24:21.328222 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321480 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:21.321482 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.321487 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.321580 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.323594 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.325011 2565 server.go:1019] "Starting client certificate rotation" Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.325108 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.325987 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 13:24:21.328700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.327428 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:24:21.332538 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.332520 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 13:24:21.347968 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.347946 2565 log.go:25] "Validated CRI v1 runtime API" Jun 05 13:24:21.350369 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.350354 2565 log.go:25] "Validated CRI v1 image API" Jun 05 13:24:21.351225 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.351210 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 13:24:21.356629 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.356612 2565 fs.go:135] Filesystem UUIDs: map[72aebafa-2617-4676-9d9e-31b1d9a98b49:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b9eee3ef-47e2-4161-8038-48b32ad8b45a:/dev/nvme0n1p4] Jun 05 13:24:21.356699 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.356628 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 13:24:21.357816 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.357801 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:24:21.361807 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.361708 2565 manager.go:216] Machine: {Timestamp:2026-06-05 13:24:21.360434865 +0000 UTC m=+0.304729185 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3053612 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec235256b0304121ac5808502e8073b5 SystemUUID:ec235256-b030-4121-ac58-08502e8073b5 BootID:1afcdc7e-23bd-43d6-9cc1-7debbfa9a996 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:21:6b:a2:69:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:21:6b:a2:69:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:0b:5c:fb:f2:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 13:24:21.361807 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.361802 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 13:24:21.361921 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.361869 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 13:24:21.363952 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.363928 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 13:24:21.364098 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.363953 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 13:24:21.365133 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.365118 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 13:24:21.365166 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.365136 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 13:24:21.365166 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.365144 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:24:21.365720 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.365710 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 13:24:21.366539 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.366530 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 13:24:21.369274 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369264 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:24:21.369388 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369378 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 13:24:21.369429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369407 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 05 13:24:21.369429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369426 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 13:24:21.369500 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369441 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 13:24:21.369500 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369450 2565 kubelet.go:398] "Adding apiserver pod source" Jun 05 13:24:21.369500 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369457 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 13:24:21.369783 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369772 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:24:21.369814 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.369791 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 13:24:21.371917 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.371901 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 13:24:21.373296 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.373282 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 13:24:21.373353 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.373312 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 13:24:21.374463 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374452 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 13:24:21.374498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374468 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 13:24:21.374498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374474 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 13:24:21.374498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374480 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 13:24:21.374498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374488 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 13:24:21.374498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374493 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374501 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374507 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374513 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374518 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374534 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374540 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374559 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 13:24:21.374666 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.374564 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 13:24:21.377687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.377673 2565 server.go:1268] "Started kubelet" Jun 05 13:24:21.377789 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.377763 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 13:24:21.377847 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.377764 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 13:24:21.377898 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.377871 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 13:24:21.378447 ip-10-0-142-213 systemd[1]: Started Kubernetes Kubelet. Jun 05 13:24:21.383005 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.382976 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 13:24:21.383372 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.383346 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:24:21.383462 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.383401 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:24:21.383588 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.383570 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:21.384474 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.384453 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 05 13:24:21.386107 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.386088 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 13:24:21.388006 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.387988 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 13:24:21.388006 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388001 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 13:24:21.388158 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.388074 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-213.ec2.internal\" not found" Jun 05 13:24:21.388702 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388682 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 13:24:21.388786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388728 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 13:24:21.388786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388743 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 13:24:21.388786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388756 2565 factory.go:55] Registering systemd factory Jun 05 13:24:21.388786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388769 2565 factory.go:223] Registration of the systemd container factory successfully Jun 05 13:24:21.388980 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388890 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 05 13:24:21.388980 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.388897 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 05 13:24:21.388980 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.387791 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa31460cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.377646795 +0000 UTC m=+0.321941094,LastTimestamp:2026-06-05 13:24:21.377646795 +0000 UTC m=+0.321941094,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.389153 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.389015 2565 factory.go:153] Registering CRI-O factory Jun 05 13:24:21.389153 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.389029 2565 factory.go:223] Registration of the crio container factory successfully Jun 05 13:24:21.389153 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.389094 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 13:24:21.389153 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.389117 2565 factory.go:103] Registering Raw factory Jun 05 13:24:21.389153 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.389141 2565 manager.go:1196] Started watching for new ooms in manager Jun 05 13:24:21.390090 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.390077 2565 manager.go:349] Starting recovery of all containers Jun 05 13:24:21.396956 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.396924 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 13:24:21.397060 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.396976 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:24:21.397060 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.397011 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 13:24:21.400474 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.400460 2565 manager.go:354] Recovery completed Jun 05 13:24:21.404774 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.404761 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.406399 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406379 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.406457 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406406 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.406457 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406415 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.406874 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406859 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 13:24:21.406874 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406872 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 13:24:21.406953 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406889 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 05 13:24:21.406953 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.406909 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.407577 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.407563 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.407632 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.407588 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.407632 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.407602 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.408031 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.408020 2565 policy_none.go:49] "None policy: Start" Jun 05 13:24:21.408493 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.408433 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.408579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.408551 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 13:24:21.408579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.408571 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 13:24:21.409472 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.409461 2565 policy_none.go:47] "Start" Jun 05 13:24:21.415719 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.415663 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.418568 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.418510 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.432057 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.431967 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.407575664 +0000 UTC m=+0.351869963,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.443816 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.443761 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.407596336 +0000 UTC m=+0.351890643,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.449575 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.449560 2565 manager.go:337] "Starting Device Plugin manager" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.449593 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.449605 2565 server.go:87] "Starting device plugin registration server" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.449821 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.449830 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.449936 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.450014 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.450023 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.450526 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.450562 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-213.ec2.internal\" not found" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.453922 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.407605957 +0000 UTC m=+0.351900256,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.457986 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.458018 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.458065 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 13:24:21.458890 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.458102 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 13:24:21.462273 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.462248 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:24:21.462372 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.462322 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa77e0347 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.451678535 +0000 UTC m=+0.395972834,LastTimestamp:2026-06-05 13:24:21.451678535 +0000 UTC m=+0.395972834,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.550569 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.550550 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.551301 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.551287 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.551366 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.551313 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.551366 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.551325 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.551366 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.551349 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.553399 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.553346 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.551301166 +0000 UTC m=+0.495595466,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.558213 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.558169 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal"] Jun 05 13:24:21.558279 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.558228 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.560799 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.560781 2565 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.560799 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.560758 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.55131832 +0000 UTC m=+0.495612626,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.561061 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.561018 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.561061 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.561060 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.561173 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.561074 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.562259 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.562248 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.562367 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.562353 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.562405 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.562381 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.562981 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.562964 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.563073 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.562996 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.563073 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.563010 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.563073 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.562966 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.563073 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.563072 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.563259 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.563083 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.564077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.564064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.564131 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.564087 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.564753 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.564741 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.564809 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.564764 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.564809 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.564774 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.569377 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.569325 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.551331334 +0000 UTC m=+0.495625637,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.579799 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.579748 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.561033275 +0000 UTC m=+0.505327578,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.589790 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.589766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/465118258f8bb9795084833298745874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" (UID: \"465118258f8bb9795084833298745874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.589790 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.589790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9405462326c3d03704d40b0e557af439-config\") pod \"kube-apiserver-proxy-ip-10-0-142-213.ec2.internal\" (UID: \"9405462326c3d03704d40b0e557af439\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.589915 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.589806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/465118258f8bb9795084833298745874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" (UID: \"465118258f8bb9795084833298745874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.589960 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.589905 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.561067615 +0000 UTC m=+0.505361915,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.593515 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.593501 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-213.ec2.internal\" not found" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.597715 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.597701 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-213.ec2.internal\" not found" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.599998 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.599981 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jun 05 13:24:21.600094 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.600008 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.561078195 +0000 UTC m=+0.505372494,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.606600 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.606545 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.562984752 +0000 UTC m=+0.507279054,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.616676 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.616618 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.563002547 +0000 UTC m=+0.507296857,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.624472 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.624410 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.563015902 +0000 UTC m=+0.507310209,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.636822 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.636769 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.563058988 +0000 UTC m=+0.507353292,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.647761 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.647707 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.563078302 +0000 UTC m=+0.507372605,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.655941 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.655883 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.563087443 +0000 UTC m=+0.507381742,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.664470 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.664416 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.564753392 +0000 UTC m=+0.509047692,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.674544 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.674490 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.564769052 +0000 UTC m=+0.509063351,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.682515 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.682464 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb6aa1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406419617 +0000 UTC m=+0.350713917,LastTimestamp:2026-06-05 13:24:21.564778075 +0000 UTC m=+0.509072375,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.690767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.690739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/465118258f8bb9795084833298745874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" (UID: \"465118258f8bb9795084833298745874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.690767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.690772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/465118258f8bb9795084833298745874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" (UID: \"465118258f8bb9795084833298745874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.690866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.690787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9405462326c3d03704d40b0e557af439-config\") pod \"kube-apiserver-proxy-ip-10-0-142-213.ec2.internal\" (UID: \"9405462326c3d03704d40b0e557af439\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.690866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.690831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9405462326c3d03704d40b0e557af439-config\") pod \"kube-apiserver-proxy-ip-10-0-142-213.ec2.internal\" (UID: \"9405462326c3d03704d40b0e557af439\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.690866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.690836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/465118258f8bb9795084833298745874-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" (UID: \"465118258f8bb9795084833298745874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.690966 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.690847 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/465118258f8bb9795084833298745874-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" (UID: \"465118258f8bb9795084833298745874\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.761882 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.761865 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:21.762615 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.762601 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:21.762678 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.762624 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:21.762678 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.762636 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:21.762678 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.762663 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.771317 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.771256 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb079b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb079b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.406394267 +0000 UTC m=+0.350688567,LastTimestamp:2026-06-05 13:24:21.76261258 +0000 UTC m=+0.706906879,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.780807 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.780757 2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-213.ec2.internal.18b6322aa4cb477c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-213.ec2.internal.18b6322aa4cb477c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-213.ec2.internal,UID:ip-10-0-142-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:21.40641062 +0000 UTC m=+0.350704919,LastTimestamp:2026-06-05 13:24:21.762628922 +0000 UTC m=+0.706923222,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:21.780905 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:21.780825 2565 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.896860 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.896809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:21.901724 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:21.901710 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:22.009305 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.009277 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Jun 05 13:24:22.181894 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.181831 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:22.182623 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.182599 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:22.182683 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.182646 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:22.182683 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.182663 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:22.182766 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.182697 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:22.200322 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.200300 2565 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:22.392618 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.392594 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:22.408777 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:22.408736 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9405462326c3d03704d40b0e557af439.slice/crio-d30a15c7f9bf7b0786b03593624db2c2ec1b8bba7f65db7fbed1eeff5ae1ee74 WatchSource:0}: Error finding container d30a15c7f9bf7b0786b03593624db2c2ec1b8bba7f65db7fbed1eeff5ae1ee74: Status 404 returned error can't find the container with id d30a15c7f9bf7b0786b03593624db2c2ec1b8bba7f65db7fbed1eeff5ae1ee74 Jun 05 13:24:22.408957 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:22.408935 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465118258f8bb9795084833298745874.slice/crio-f147e7f57fbcd1d7e003b317cbdabdcaa35aff8ce4c1157ed67013230fa15c07 WatchSource:0}: Error finding container f147e7f57fbcd1d7e003b317cbdabdcaa35aff8ce4c1157ed67013230fa15c07: Status 404 returned error can't find the container with id f147e7f57fbcd1d7e003b317cbdabdcaa35aff8ce4c1157ed67013230fa15c07 Jun 05 13:24:22.415533 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.415173 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:24:22.423060 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.422736 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:24:22.423060 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.422684 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal.18b6322ae0ef9531 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal,UID:465118258f8bb9795084833298745874,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c46116fef319d12c66333805d7ff38d291796e1c1ea1a7407263e914f37c2ea\",Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:22.415422769 +0000 UTC m=+1.359717070,LastTimestamp:2026-06-05 13:24:22.415422769 +0000 UTC m=+1.359717070,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:22.424528 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.424469 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-213.ec2.internal.18b6322ae0f3ccdd kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-213.ec2.internal,UID:9405462326c3d03704d40b0e557af439,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff2a1b99a07e285ee709042ae253d7022ca12b5906327bc8c069bcd0acd749ae\",Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:22.415699165 +0000 UTC m=+1.359993457,LastTimestamp:2026-06-05 13:24:22.415699165 +0000 UTC m=+1.359993457,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:22.461433 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.461396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" event={"ID":"465118258f8bb9795084833298745874","Type":"ContainerStarted","Data":"f147e7f57fbcd1d7e003b317cbdabdcaa35aff8ce4c1157ed67013230fa15c07"} Jun 05 13:24:22.462323 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.462304 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" event={"ID":"9405462326c3d03704d40b0e557af439","Type":"ContainerStarted","Data":"d30a15c7f9bf7b0786b03593624db2c2ec1b8bba7f65db7fbed1eeff5ae1ee74"} Jun 05 13:24:22.560832 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.560811 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:22.561695 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.561679 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:22.561756 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.561713 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:22.561756 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:22.561724 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:22.803543 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.803467 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 13:24:22.816509 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.816473 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:24:22.816623 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.816551 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" Jun 05 13:24:22.936003 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:22.935967 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 13:24:23.001391 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:23.001365 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:23.002971 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:23.002948 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:23.003097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:23.002984 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:23.003097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:23.002999 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:23.003097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:23.003032 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:23.020950 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:23.020924 2565 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:23.395165 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:23.395140 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:24.315168 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.315096 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal.18b6322b518e29c6 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal,UID:465118258f8bb9795084833298745874,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0c46116fef319d12c66333805d7ff38d291796e1c1ea1a7407263e914f37c2ea\" in 1.889s (1.889s including waiting). Image size: 292844543 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:24.304863686 +0000 UTC m=+3.249157991,LastTimestamp:2026-06-05 13:24:24.304863686 +0000 UTC m=+3.249157991,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:24.339018 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.338931 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-213.ec2.internal.18b6322b52c9f691 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-213.ec2.internal,UID:9405462326c3d03704d40b0e557af439,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ff2a1b99a07e285ee709042ae253d7022ca12b5906327bc8c069bcd0acd749ae\" in 1.909s (1.909s including waiting). Image size: 331825624 bytes.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:24.325559953 +0000 UTC m=+3.269854240,LastTimestamp:2026-06-05 13:24:24.325559953 +0000 UTC m=+3.269854240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:24.396551 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.396531 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 13:24:24.396932 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.396546 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-213.ec2.internal.18b6322b567f80a1 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-213.ec2.internal,UID:9405462326c3d03704d40b0e557af439,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Created,Message:Created container: haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:24.387788961 +0000 UTC m=+3.332083268,LastTimestamp:2026-06-05 13:24:24.387788961 +0000 UTC m=+3.332083268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:24.401950 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.401873 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"kube-system\"" event="&Event{ObjectMeta:{kube-apiserver-proxy-ip-10-0-142-213.ec2.internal.18b6322b56d88699 kube-system 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:kube-system,Name:kube-apiserver-proxy-ip-10-0-142-213.ec2.internal,UID:9405462326c3d03704d40b0e557af439,APIVersion:v1,ResourceVersion:,FieldPath:spec.containers{haproxy},},Reason:Started,Message:Started container haproxy,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:24.393623193 +0000 UTC m=+3.337917484,LastTimestamp:2026-06-05 13:24:24.393623193 +0000 UTC m=+3.337917484,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:24.420209 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.420187 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s" Jun 05 13:24:24.464664 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.464635 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 05 13:24:24.466623 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.466598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" event={"ID":"9405462326c3d03704d40b0e557af439","Type":"ContainerStarted","Data":"175fe2d2b4db62a8409a9d4412eb10a859bd0eeb02bee2e4ce95a0f8142f14d9"} Jun 05 13:24:24.466714 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.466654 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:24.467599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.467578 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:24.467697 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.467619 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:24.467697 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.467636 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:24.467837 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.467822 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-213.ec2.internal\" not found" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:24.507852 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.507823 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 13:24:24.542611 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.542544 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal.18b6322b5f26bd74 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal,UID:465118258f8bb9795084833298745874,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:24.532966772 +0000 UTC m=+3.477261081,LastTimestamp:2026-06-05 13:24:24.532966772 +0000 UTC m=+3.477261081,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:24.552433 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.552365 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal.18b6322b5f910aa7 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal,UID:465118258f8bb9795084833298745874,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:ip-10-0-142-213.ec2.internal,},FirstTimestamp:2026-06-05 13:24:24.539933351 +0000 UTC m=+3.484227638,LastTimestamp:2026-06-05 13:24:24.539933351 +0000 UTC m=+3.484227638,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-213.ec2.internal,}" Jun 05 13:24:24.559359 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.559340 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9zn67" Jun 05 13:24:24.568006 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.567992 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9zn67" Jun 05 13:24:24.621324 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.621299 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 13:24:24.622226 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.622211 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientMemory" Jun 05 13:24:24.622300 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.622243 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 13:24:24.622300 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.622254 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeHasSufficientPID" Jun 05 13:24:24.622300 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.622283 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:24.636312 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.636294 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-213.ec2.internal" Jun 05 13:24:24.636356 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.636315 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-213.ec2.internal\": node \"ip-10-0-142-213.ec2.internal\" not found" Jun 05 13:24:24.662127 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:24.662107 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-213.ec2.internal\" not found" Jun 05 13:24:24.721398 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.721380 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:24:24.788710 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.788685 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:24.850437 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.850354 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:24:24.851781 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.851764 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:24.860606 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:24.860586 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:24:25.324085 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.324058 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 13:24:25.371507 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.371483 2565 apiserver.go:52] "Watching apiserver" Jun 05 13:24:25.379737 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.379713 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 13:24:25.380673 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.380652 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-lkb84","openshift-ovn-kubernetes/ovnkube-node-gkxkz","kube-system/konnectivity-agent-gsz5v","kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal","openshift-dns/node-resolver-b8gbk","openshift-image-registry/node-ca-wm82f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal","openshift-multus/multus-2prgt","openshift-multus/network-metrics-daemon-wbcds","openshift-network-diagnostics/network-check-target-prc6s","kube-system/global-pull-secret-syncer-2xjfw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq","openshift-cluster-node-tuning-operator/tuned-6gbvv","openshift-multus/multus-additional-cni-plugins-m8f7d"] Jun 05 13:24:25.382163 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.382147 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.382253 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.382235 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:25.383431 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.383413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.384799 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.384782 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.386269 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.386307 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.386498 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z7jnp\"" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.386838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.387377 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.387653 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.387752 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.387914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.387798 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xqcpt\"" Jun 05 13:24:25.388335 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.388260 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.388680 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.388662 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 13:24:25.389401 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.389284 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 13:24:25.389401 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.389357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dwsv6\"" Jun 05 13:24:25.389547 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.389418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:25.389547 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.389492 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 13:24:25.389547 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.389492 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:25.389547 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.389522 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.389754 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.389624 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.391255 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.391240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.392940 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.392922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.393584 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.393563 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.393686 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.393669 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.393823 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.393811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qb4ng\"" Jun 05 13:24:25.395441 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.395427 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:25.395514 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.395495 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:25.395921 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.395908 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 13:24:25.396948 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.396929 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 13:24:25.396948 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.396945 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.397362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.396960 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 13:24:25.397362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.397019 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.397362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.397086 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9cxjk\"" Jun 05 13:24:25.397362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.397317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.397362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.397331 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 13:24:25.399135 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.399118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.400244 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.400218 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.400323 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.400247 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 13:24:25.400417 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.400402 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.400498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.400482 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6vqdz\"" Jun 05 13:24:25.401114 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.401100 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.401551 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.401537 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95j7p\"" Jun 05 13:24:25.401864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.401848 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.401864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.401861 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.402006 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.401850 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 13:24:25.403267 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.403249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.403485 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.403466 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 13:24:25.403800 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.403775 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wdh55\"" Jun 05 13:24:25.404260 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.404243 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 13:24:25.405467 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.405452 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 13:24:25.405771 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.405754 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zn2lg\"" Jun 05 13:24:25.405877 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.405783 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 13:24:25.410087 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5z4d\" (UniqueName: \"kubernetes.io/projected/b1f6139d-854e-43a5-ab53-4c0689e9abe3-kube-api-access-t5z4d\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:25.410162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f5309f4-e8bc-411f-81dc-fc842320ce8d-agent-certs\") pod \"konnectivity-agent-gsz5v\" (UID: \"3f5309f4-e8bc-411f-81dc-fc842320ce8d\") " pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.410162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:25.410257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-kubelet-config\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.410257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzgd8\" (UniqueName: \"kubernetes.io/projected/195a2f0b-8156-45fa-802f-c31fe869e706-kube-api-access-zzgd8\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.410374 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410270 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-os-release\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410374 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00848e40-2fdf-4321-a336-e8363b12c652-host\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.410374 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00848e40-2fdf-4321-a336-e8363b12c652-serviceca\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.410374 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410335 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-dbus\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.410374 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f5309f4-e8bc-411f-81dc-fc842320ce8d-konnectivity-ca\") pod \"konnectivity-agent-gsz5v\" (UID: \"3f5309f4-e8bc-411f-81dc-fc842320ce8d\") " pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.410518 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-system-cni-dir\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410518 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-cnibin\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410518 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410518 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.410518 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.410476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7gp8\" (UniqueName: \"kubernetes.io/projected/00848e40-2fdf-4321-a336-e8363b12c652-kube-api-access-n7gp8\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.468955 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.468928 2565 generic.go:356] "Generic (PLEG): container finished" podID="465118258f8bb9795084833298745874" containerID="e82acf3aa1691e26dca7061a58c7ee5716d800a62df5d6396cc4dc92d32e449f" exitCode=0 Jun 05 13:24:25.469069 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.469010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" event={"ID":"465118258f8bb9795084833298745874","Type":"ContainerDied","Data":"e82acf3aa1691e26dca7061a58c7ee5716d800a62df5d6396cc4dc92d32e449f"} Jun 05 13:24:25.469148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.469114 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:25.469253 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.469240 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:25.485839 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.485819 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:24:25.485928 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.485858 2565 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-142-213.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" Jun 05 13:24:25.489062 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.489028 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 13:24:25.489161 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.489080 2565 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" Jun 05 13:24:25.489875 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.489737 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 13:24:25.511594 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-system-cni-dir\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.511690 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7gp8\" (UniqueName: \"kubernetes.io/projected/00848e40-2fdf-4321-a336-e8363b12c652-kube-api-access-n7gp8\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.511690 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brz99\" (UniqueName: \"kubernetes.io/projected/f96183bd-6921-4969-94c9-a16849fcc848-kube-api-access-brz99\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.511690 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511666 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-system-cni-dir\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.511690 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-modprobe-d\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.511876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-kubernetes\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.511876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-run\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.511876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:25.511876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:25.511876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-ovnkube-config\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.511876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511868 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pd7p\" (UniqueName: \"kubernetes.io/projected/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-kube-api-access-4pd7p\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f96183bd-6921-4969-94c9-a16849fcc848-multus-daemon-config\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-etc-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.511957 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.511986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-cni-bin\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.512063 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:26.012029024 +0000 UTC m=+4.956323321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-device-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-k8s-cni-cncf-io\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.512164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-systemd\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-ovnkube-script-lib\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512196 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f5309f4-e8bc-411f-81dc-fc842320ce8d-konnectivity-ca\") pod \"konnectivity-agent-gsz5v\" (UID: \"3f5309f4-e8bc-411f-81dc-fc842320ce8d\") " pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512231 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh96l\" (UniqueName: \"kubernetes.io/projected/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-kube-api-access-qh96l\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512407 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-socket-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-registration-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-sys-fs\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f5309f4-e8bc-411f-81dc-fc842320ce8d-agent-certs\") pod \"konnectivity-agent-gsz5v\" (UID: \"3f5309f4-e8bc-411f-81dc-fc842320ce8d\") " pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-cnibin\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.512590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-netns\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512641 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-hostroot\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512677 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-ovn\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-node-log\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-socket-dir-parent\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-conf-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-etc-kubernetes\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f5309f4-e8bc-411f-81dc-fc842320ce8d-konnectivity-ca\") pod \"konnectivity-agent-gsz5v\" (UID: \"3f5309f4-e8bc-411f-81dc-fc842320ce8d\") " pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512839 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrvx\" (UniqueName: \"kubernetes.io/projected/bfb2ef31-70ea-424d-a920-baed0b742420-kube-api-access-zzrvx\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512858 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-tuned\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-os-release\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-dbus\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.512991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f96183bd-6921-4969-94c9-a16849fcc848-cni-binary-copy\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5z4d\" (UniqueName: \"kubernetes.io/projected/b1f6139d-854e-43a5-ab53-4c0689e9abe3-kube-api-access-t5z4d\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-var-lib-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.513110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-cni-netd\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513097 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-systemd\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-sys\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513117 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-os-release\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-lib-modules\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-var-lib-kubelet\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-dbus\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-os-release\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-multus-certs\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzgd8\" (UniqueName: \"kubernetes.io/projected/195a2f0b-8156-45fa-802f-c31fe869e706-kube-api-access-zzgd8\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysconfig\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.513471 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513509 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysctl-conf\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.513535 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:24:26.013510769 +0000 UTC m=+4.957805056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:25.513866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513566 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513567 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ldr\" (UniqueName: \"kubernetes.io/projected/19e20ac1-a966-417d-a4af-1de0f77c4cfc-kube-api-access-l6ldr\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-cni-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-cni-bin\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-kubelet\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513720 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-hosts-file\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-slash\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513832 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19e20ac1-a966-417d-a4af-1de0f77c4cfc-tmp\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-kubelet-config\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-cnibin\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-kubelet\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513939 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-kubelet-config\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:25.514499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513953 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-tmp-dir\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.513986 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-host\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-run-netns\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514071 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-env-overrides\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfb2ef31-70ea-424d-a920-baed0b742420-ovn-node-metrics-cert\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-iptables-alerter-script\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00848e40-2fdf-4321-a336-e8363b12c652-host\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514252 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00848e40-2fdf-4321-a336-e8363b12c652-serviceca\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-cni-multus\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514322 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00848e40-2fdf-4321-a336-e8363b12c652-host\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195a2f0b-8156-45fa-802f-c31fe869e706-cnibin\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-systemd-units\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-log-socket\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195a2f0b-8156-45fa-802f-c31fe869e706-cni-binary-copy\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.515219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysctl-d\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.515969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-host-slash\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.515969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chzvl\" (UniqueName: \"kubernetes.io/projected/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-kube-api-access-chzvl\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.515969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-system-cni-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.515969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.514716 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/00848e40-2fdf-4321-a336-e8363b12c652-serviceca\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.517393 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.517232 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f5309f4-e8bc-411f-81dc-fc842320ce8d-agent-certs\") pod \"konnectivity-agent-gsz5v\" (UID: \"3f5309f4-e8bc-411f-81dc-fc842320ce8d\") " pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.522606 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.522587 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7gp8\" (UniqueName: \"kubernetes.io/projected/00848e40-2fdf-4321-a336-e8363b12c652-kube-api-access-n7gp8\") pod \"node-ca-wm82f\" (UID: \"00848e40-2fdf-4321-a336-e8363b12c652\") " pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.524863 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.524841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzgd8\" (UniqueName: \"kubernetes.io/projected/195a2f0b-8156-45fa-802f-c31fe869e706-kube-api-access-zzgd8\") pod \"multus-additional-cni-plugins-m8f7d\" (UID: \"195a2f0b-8156-45fa-802f-c31fe869e706\") " pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.524946 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.524917 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5z4d\" (UniqueName: \"kubernetes.io/projected/b1f6139d-854e-43a5-ab53-4c0689e9abe3-kube-api-access-t5z4d\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:25.546517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.546452 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-213.ec2.internal" podStartSLOduration=1.546439392 podStartE2EDuration="1.546439392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:25.532779015 +0000 UTC m=+4.477073324" watchObservedRunningTime="2026-06-05 13:24:25.546439392 +0000 UTC m=+4.490733678" Jun 05 13:24:25.570572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.570536 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 13:19:24 +0000 UTC" deadline="2028-03-05 07:18:06.999632486 +0000 UTC" Jun 05 13:24:25.570572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.570571 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15329h53m41.429063874s" Jun 05 13:24:25.615085 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.614944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh96l\" (UniqueName: \"kubernetes.io/projected/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-kube-api-access-qh96l\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.615180 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-socket-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.615180 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-registration-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.615180 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-sys-fs\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-cnibin\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-netns\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-hostroot\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615235 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-registration-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-ovn\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615243 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-sys-fs\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615265 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-socket-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-hostroot\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-node-log\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615318 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-ovn\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-cnibin\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-node-log\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615336 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-netns\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-socket-dir-parent\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-conf-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615390 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-socket-dir-parent\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-etc-kubernetes\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrvx\" (UniqueName: \"kubernetes.io/projected/bfb2ef31-70ea-424d-a920-baed0b742420-kube-api-access-zzrvx\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615431 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-conf-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-tuned\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-etc-kubernetes\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615462 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f96183bd-6921-4969-94c9-a16849fcc848-cni-binary-copy\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-var-lib-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-cni-netd\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-systemd\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-sys\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-cni-netd\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615596 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-systemd\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.615764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-sys\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-var-lib-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615648 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-lib-modules\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-var-lib-kubelet\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-os-release\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-multus-certs\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615743 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-var-lib-kubelet\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615753 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-lib-modules\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-multus-certs\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615785 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-os-release\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615817 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysconfig\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysctl-conf\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ldr\" (UniqueName: \"kubernetes.io/projected/19e20ac1-a966-417d-a4af-1de0f77c4cfc-kube-api-access-l6ldr\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615872 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysconfig\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-cni-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-cni-bin\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615926 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-multus-cni-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615937 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysctl-conf\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.616564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-kubelet\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-cni-bin\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-hosts-file\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615972 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-kubelet\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f96183bd-6921-4969-94c9-a16849fcc848-cni-binary-copy\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.615999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-slash\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616008 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-hosts-file\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-slash\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-run-ovn-kubernetes\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19e20ac1-a966-417d-a4af-1de0f77c4cfc-tmp\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-kubelet\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-tmp-dir\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616164 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-kubelet\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-host\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.617438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-run-netns\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616241 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616302 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-host\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-run-netns\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-env-overrides\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfb2ef31-70ea-424d-a920-baed0b742420-ovn-node-metrics-cert\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616401 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-tmp-dir\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-iptables-alerter-script\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616462 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-cni-multus\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-systemd-units\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-log-socket\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysctl-d\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-host-slash\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chzvl\" (UniqueName: \"kubernetes.io/projected/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-kube-api-access-chzvl\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616608 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-system-cni-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brz99\" (UniqueName: \"kubernetes.io/projected/f96183bd-6921-4969-94c9-a16849fcc848-kube-api-access-brz99\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616660 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-modprobe-d\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616689 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-kubernetes\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.618126 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616700 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-env-overrides\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-run\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616751 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-run\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-var-lib-cni-multus\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-ovnkube-config\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pd7p\" (UniqueName: \"kubernetes.io/projected/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-kube-api-access-4pd7p\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616831 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-systemd-units\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f96183bd-6921-4969-94c9-a16849fcc848-multus-daemon-config\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-log-socket\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-etc-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-cni-bin\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616903 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-iptables-alerter-script\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616925 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-device-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-k8s-cni-cncf-io\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616982 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-host-slash\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.618777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-systemd\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-ovnkube-script-lib\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-etc-selinux\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-system-cni-dir\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617262 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-etc-openvswitch\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-kubernetes\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-modprobe-d\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-host-cni-bin\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f96183bd-6921-4969-94c9-a16849fcc848-host-run-k8s-cni-cncf-io\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-device-dir\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-ovnkube-config\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.616952 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-sysctl-d\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617657 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bfb2ef31-70ea-424d-a920-baed0b742420-run-systemd\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.617743 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19e20ac1-a966-417d-a4af-1de0f77c4cfc-etc-tuned\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.618105 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bfb2ef31-70ea-424d-a920-baed0b742420-ovnkube-script-lib\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.618218 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19e20ac1-a966-417d-a4af-1de0f77c4cfc-tmp\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.619247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.618433 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bfb2ef31-70ea-424d-a920-baed0b742420-ovn-node-metrics-cert\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.619733 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.618500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f96183bd-6921-4969-94c9-a16849fcc848-multus-daemon-config\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.624903 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.624885 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh96l\" (UniqueName: \"kubernetes.io/projected/36e7f949-4ced-4d2c-ba2e-7e9d319488ac-kube-api-access-qh96l\") pod \"node-resolver-b8gbk\" (UID: \"36e7f949-4ced-4d2c-ba2e-7e9d319488ac\") " pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.625069 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.625054 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:25.625150 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.625072 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:25.625150 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.625081 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:25.625150 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:25.625136 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:26.125114724 +0000 UTC m=+5.069409023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:25.628495 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.628474 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brz99\" (UniqueName: \"kubernetes.io/projected/f96183bd-6921-4969-94c9-a16849fcc848-kube-api-access-brz99\") pod \"multus-2prgt\" (UID: \"f96183bd-6921-4969-94c9-a16849fcc848\") " pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.628853 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.628833 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ldr\" (UniqueName: \"kubernetes.io/projected/19e20ac1-a966-417d-a4af-1de0f77c4cfc-kube-api-access-l6ldr\") pod \"tuned-6gbvv\" (UID: \"19e20ac1-a966-417d-a4af-1de0f77c4cfc\") " pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.628926 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.628878 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrvx\" (UniqueName: \"kubernetes.io/projected/bfb2ef31-70ea-424d-a920-baed0b742420-kube-api-access-zzrvx\") pod \"ovnkube-node-gkxkz\" (UID: \"bfb2ef31-70ea-424d-a920-baed0b742420\") " pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.629539 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.629520 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chzvl\" (UniqueName: \"kubernetes.io/projected/2720b512-e1b7-47d4-ac4b-505e68f9cb4c-kube-api-access-chzvl\") pod \"iptables-alerter-lkb84\" (UID: \"2720b512-e1b7-47d4-ac4b-505e68f9cb4c\") " pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.629696 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.629679 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pd7p\" (UniqueName: \"kubernetes.io/projected/b33085e5-2ec6-4bdc-90ff-fa9f15002d4b-kube-api-access-4pd7p\") pod \"aws-ebs-csi-driver-node-zxlgq\" (UID: \"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.695237 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.695216 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:25.701653 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.701634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" Jun 05 13:24:25.706127 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.706109 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5309f4_e8bc_411f_81dc_fc842320ce8d.slice/crio-f0514cce3728239a1c8ac8e0b0504130d8cba049e031e03b4de01d97ebbac9e8 WatchSource:0}: Error finding container f0514cce3728239a1c8ac8e0b0504130d8cba049e031e03b4de01d97ebbac9e8: Status 404 returned error can't find the container with id f0514cce3728239a1c8ac8e0b0504130d8cba049e031e03b4de01d97ebbac9e8 Jun 05 13:24:25.706209 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.706160 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wm82f" Jun 05 13:24:25.710765 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.710742 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195a2f0b_8156_45fa_802f_c31fe869e706.slice/crio-13a3c331cd9a3f8defb8c8c44fe6f5c486c44f190b69e2ba6b2d9dc34df764be WatchSource:0}: Error finding container 13a3c331cd9a3f8defb8c8c44fe6f5c486c44f190b69e2ba6b2d9dc34df764be: Status 404 returned error can't find the container with id 13a3c331cd9a3f8defb8c8c44fe6f5c486c44f190b69e2ba6b2d9dc34df764be Jun 05 13:24:25.712459 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.712443 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" Jun 05 13:24:25.716484 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.716465 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00848e40_2fdf_4321_a336_e8363b12c652.slice/crio-9398f351479bb6bd5498a832068ecdfa574da60a125f499225de65289372afac WatchSource:0}: Error finding container 9398f351479bb6bd5498a832068ecdfa574da60a125f499225de65289372afac: Status 404 returned error can't find the container with id 9398f351479bb6bd5498a832068ecdfa574da60a125f499225de65289372afac Jun 05 13:24:25.717096 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.717077 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:25.720859 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.720842 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e20ac1_a966_417d_a4af_1de0f77c4cfc.slice/crio-080d19f6349a523f305bb0fbf8052bb978652ad4bd99ec0ddb4e9ad71dbb160d WatchSource:0}: Error finding container 080d19f6349a523f305bb0fbf8052bb978652ad4bd99ec0ddb4e9ad71dbb160d: Status 404 returned error can't find the container with id 080d19f6349a523f305bb0fbf8052bb978652ad4bd99ec0ddb4e9ad71dbb160d Jun 05 13:24:25.721814 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.721797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lkb84" Jun 05 13:24:25.725965 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.725950 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb2ef31_70ea_424d_a920_baed0b742420.slice/crio-f1a3a1ca3c681460b6c2e7eac759ff4068f0e31791e2b9c353bfcd929aad964a WatchSource:0}: Error finding container f1a3a1ca3c681460b6c2e7eac759ff4068f0e31791e2b9c353bfcd929aad964a: Status 404 returned error can't find the container with id f1a3a1ca3c681460b6c2e7eac759ff4068f0e31791e2b9c353bfcd929aad964a Jun 05 13:24:25.726732 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.726720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" Jun 05 13:24:25.730832 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.730816 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2720b512_e1b7_47d4_ac4b_505e68f9cb4c.slice/crio-eb0044399b27d0ed26a47d177e617c62fe63fda440df7378c54c9332f712ccea WatchSource:0}: Error finding container eb0044399b27d0ed26a47d177e617c62fe63fda440df7378c54c9332f712ccea: Status 404 returned error can't find the container with id eb0044399b27d0ed26a47d177e617c62fe63fda440df7378c54c9332f712ccea Jun 05 13:24:25.734723 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.734706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2prgt" Jun 05 13:24:25.736230 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.736211 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33085e5_2ec6_4bdc_90ff_fa9f15002d4b.slice/crio-b0937976a87df309f1893dabe3884333e420200e442e7657658af86f35b60e9d WatchSource:0}: Error finding container b0937976a87df309f1893dabe3884333e420200e442e7657658af86f35b60e9d: Status 404 returned error can't find the container with id b0937976a87df309f1893dabe3884333e420200e442e7657658af86f35b60e9d Jun 05 13:24:25.738140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:25.738118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b8gbk" Jun 05 13:24:25.744543 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.744527 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf96183bd_6921_4969_94c9_a16849fcc848.slice/crio-dc8e7df15726c265e7f085c4bd966c8b882e5f79eda9fcbc18bea33783678af6 WatchSource:0}: Error finding container dc8e7df15726c265e7f085c4bd966c8b882e5f79eda9fcbc18bea33783678af6: Status 404 returned error can't find the container with id dc8e7df15726c265e7f085c4bd966c8b882e5f79eda9fcbc18bea33783678af6 Jun 05 13:24:25.747242 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:25.747225 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e7f949_4ced_4d2c_ba2e_7e9d319488ac.slice/crio-606598e211d3217a46df94c04081b1fe92414a9ff4b2b26b649191c0cc5f671a WatchSource:0}: Error finding container 606598e211d3217a46df94c04081b1fe92414a9ff4b2b26b649191c0cc5f671a: Status 404 returned error can't find the container with id 606598e211d3217a46df94c04081b1fe92414a9ff4b2b26b649191c0cc5f671a Jun 05 13:24:26.019353 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.019332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:26.019470 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.019373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:26.019506 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.019477 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:26.019535 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.019524 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:26.019577 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.019526 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:24:27.019513103 +0000 UTC m=+5.963807393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:26.019577 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.019567 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:27.019555543 +0000 UTC m=+5.963849830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:26.221056 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.221010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:26.221240 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.221222 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:26.221296 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.221246 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:26.221296 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.221259 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:26.221406 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:26.221319 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:27.221300089 +0000 UTC m=+6.165594396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:26.436323 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.436249 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7xg77" Jun 05 13:24:26.445721 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.445664 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7xg77" Jun 05 13:24:26.476684 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.475455 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gsz5v" event={"ID":"3f5309f4-e8bc-411f-81dc-fc842320ce8d","Type":"ContainerStarted","Data":"f0514cce3728239a1c8ac8e0b0504130d8cba049e031e03b4de01d97ebbac9e8"} Jun 05 13:24:26.488735 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.488707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b8gbk" event={"ID":"36e7f949-4ced-4d2c-ba2e-7e9d319488ac","Type":"ContainerStarted","Data":"606598e211d3217a46df94c04081b1fe92414a9ff4b2b26b649191c0cc5f671a"} Jun 05 13:24:26.496379 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.496353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2prgt" event={"ID":"f96183bd-6921-4969-94c9-a16849fcc848","Type":"ContainerStarted","Data":"dc8e7df15726c265e7f085c4bd966c8b882e5f79eda9fcbc18bea33783678af6"} Jun 05 13:24:26.500057 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.500022 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" event={"ID":"19e20ac1-a966-417d-a4af-1de0f77c4cfc","Type":"ContainerStarted","Data":"080d19f6349a523f305bb0fbf8052bb978652ad4bd99ec0ddb4e9ad71dbb160d"} Jun 05 13:24:26.520248 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.520222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerStarted","Data":"13a3c331cd9a3f8defb8c8c44fe6f5c486c44f190b69e2ba6b2d9dc34df764be"} Jun 05 13:24:26.528529 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.528490 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:24:26.529062 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.529024 2565 generic.go:356] "Generic (PLEG): container finished" podID="465118258f8bb9795084833298745874" containerID="91a12f8385214b58567c0ebf7ca9ed5fe0782e68cde97dd041a7382a2067d291" exitCode=1 Jun 05 13:24:26.529169 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.529111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" event={"ID":"465118258f8bb9795084833298745874","Type":"ContainerDied","Data":"91a12f8385214b58567c0ebf7ca9ed5fe0782e68cde97dd041a7382a2067d291"} Jun 05 13:24:26.529431 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.529412 2565 scope.go:117] "RemoveContainer" containerID="91a12f8385214b58567c0ebf7ca9ed5fe0782e68cde97dd041a7382a2067d291" Jun 05 13:24:26.548760 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.548732 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" event={"ID":"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b","Type":"ContainerStarted","Data":"b0937976a87df309f1893dabe3884333e420200e442e7657658af86f35b60e9d"} Jun 05 13:24:26.569928 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.569899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lkb84" event={"ID":"2720b512-e1b7-47d4-ac4b-505e68f9cb4c","Type":"ContainerStarted","Data":"eb0044399b27d0ed26a47d177e617c62fe63fda440df7378c54c9332f712ccea"} Jun 05 13:24:26.576394 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.576368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"f1a3a1ca3c681460b6c2e7eac759ff4068f0e31791e2b9c353bfcd929aad964a"} Jun 05 13:24:26.578463 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:26.578440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wm82f" event={"ID":"00848e40-2fdf-4321-a336-e8363b12c652","Type":"ContainerStarted","Data":"9398f351479bb6bd5498a832068ecdfa574da60a125f499225de65289372afac"} Jun 05 13:24:27.026657 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.026573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:27.026823 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.026717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:27.026823 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.026739 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:27.026823 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.026815 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:29.026794821 +0000 UTC m=+7.971089123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:27.026991 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.026834 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:27.026991 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.026886 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:24:29.026870721 +0000 UTC m=+7.971165030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:27.228769 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.228717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:27.228959 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.228942 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:27.229022 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.228968 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:27.229022 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.228982 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:27.229179 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.229053 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:29.229021679 +0000 UTC m=+8.173315966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:27.449314 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.449276 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 13:19:26 +0000 UTC" deadline="2028-02-08 16:37:32.768949397 +0000 UTC" Jun 05 13:24:27.449314 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.449312 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14715h13m5.319641733s" Jun 05 13:24:27.459510 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.459488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:27.459627 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.459605 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:27.460005 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.459983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:27.460133 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.460112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:27.460229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.460215 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:27.460378 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:27.460293 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:27.588725 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.588509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:24:27.591744 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.591604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" event={"ID":"465118258f8bb9795084833298745874","Type":"ContainerStarted","Data":"7117a12d097e677f86b63dd6e4e16d81f717b998a04c0f11566d21652ed6a558"} Jun 05 13:24:27.684383 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:27.684315 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:24:28.188082 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:28.188053 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 13:24:28.450317 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:28.450280 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 13:19:26 +0000 UTC" deadline="2027-11-13 05:29:32.238971953 +0000 UTC" Jun 05 13:24:28.450317 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:28.450317 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12616h5m3.788660174s" Jun 05 13:24:29.044519 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:29.044435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:29.044519 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:29.044512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:29.044812 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.044666 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:29.044812 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.044727 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:33.044708423 +0000 UTC m=+11.989002713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:29.045168 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.045115 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:29.045277 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.045208 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:24:33.045189067 +0000 UTC m=+11.989483360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:29.245836 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:29.245803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:29.246077 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.246026 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:29.246077 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.246061 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:29.246077 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.246074 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:29.246436 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.246129 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:33.246110804 +0000 UTC m=+12.190405096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:29.460162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:29.460130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:29.460588 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:29.460136 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:29.464362 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.464173 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:29.464362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:29.460147 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:29.464362 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.464320 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:29.464615 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:29.464435 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:31.458805 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:31.458338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:31.458805 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:31.458372 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:31.458805 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:31.458338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:31.458805 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:31.458454 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:31.458805 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:31.458537 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:31.458805 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:31.458604 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:33.076289 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:33.076243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:33.076710 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:33.076314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:33.076710 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.076431 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:33.076710 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.076495 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:24:41.076476416 +0000 UTC m=+20.020770720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:33.076710 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.076431 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:33.076710 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.076552 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:41.076539608 +0000 UTC m=+20.020833909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:33.277786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:33.277749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:33.277990 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.277973 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:33.278136 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.277996 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:33.278136 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.278009 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:33.278136 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.278084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:41.278065891 +0000 UTC m=+20.222360195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:33.458849 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:33.458372 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:33.458849 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:33.458413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:33.458849 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:33.458411 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:33.458849 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.458511 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:33.458849 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.458656 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:33.458849 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:33.458742 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:35.459067 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:35.459024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:35.459428 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:35.459025 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:35.459428 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:35.459145 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:35.459428 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:35.459162 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:35.459428 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:35.459263 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:35.459428 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:35.459341 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:37.458443 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:37.458410 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:37.458904 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:37.458417 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:37.458904 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:37.458534 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:37.458904 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:37.458616 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:37.458904 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:37.458679 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:37.458904 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:37.458806 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:39.458761 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:39.458722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:39.459257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:39.458722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:39.459257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:39.458849 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:39.459257 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:39.458856 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:39.459257 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:39.458927 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:39.459257 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:39.459000 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:41.142254 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:41.142171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:41.142254 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:41.142239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:41.142820 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.142321 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:41.142820 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.142345 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:41.142820 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.142397 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:24:57.14237558 +0000 UTC m=+36.086669870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:41.142820 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.142419 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:57.142409192 +0000 UTC m=+36.086703487 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:41.343726 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:41.343697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:41.343895 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.343844 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:41.343895 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.343861 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:41.343895 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.343869 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:41.344011 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.343925 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:57.343908918 +0000 UTC m=+36.288203210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:41.459605 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:41.459570 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:41.459791 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:41.459686 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:41.459791 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.459690 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:41.459791 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:41.459716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:41.459791 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.459784 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:41.460005 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:41.459835 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:43.459017 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:43.458983 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:43.459521 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:43.459049 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:43.459521 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:43.459062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:43.459521 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:43.459133 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:43.459521 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:43.459215 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:43.459521 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:43.459301 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:45.458931 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.458609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:45.459699 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.458613 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:45.459699 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:45.459074 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:45.459699 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:45.459090 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:45.459699 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.458661 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:45.459699 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:45.459160 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:45.626505 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.626473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" event={"ID":"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b","Type":"ContainerStarted","Data":"d532f22e66ac7c2d85ee677dbd55e433ad401554e51da25d848c13e7a3bc7918"} Jun 05 13:24:45.629284 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.629257 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"20009b22942322c9db83b940bf43e6f2fa9004621cd8028135608008533f52aa"} Jun 05 13:24:45.629411 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.629316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"d892bd7a951c6157ff4ef75855c24ac13e7a104e8c0a4ef322f855afde0c1d7b"} Jun 05 13:24:45.629411 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.629346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"86282d28eb677f053dc7a9d0c1ef7f3aa07f1ca8dc9ad68871709eefab58836a"} Jun 05 13:24:45.629411 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.629375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"ba5d5a0962c407679ee208a535c870179b1232f8bd3836f76ee0d8b313e56de4"} Jun 05 13:24:45.629547 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.629417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"e912dcb10381206354ae90b2c8ff3b76a8b9830e36be551fd557a128c4819607"} Jun 05 13:24:45.629547 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.629448 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"c306cacb776e519aef88b65b5f711f6f159b3fc751ed580acba7f8456f24e17a"} Jun 05 13:24:45.630632 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.630605 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wm82f" event={"ID":"00848e40-2fdf-4321-a336-e8363b12c652","Type":"ContainerStarted","Data":"61434f7096ebcb77cfcbbfa310d1117682665e46f1366d082d46de6fc330fa6c"} Jun 05 13:24:45.631868 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.631840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gsz5v" event={"ID":"3f5309f4-e8bc-411f-81dc-fc842320ce8d","Type":"ContainerStarted","Data":"eba612c3a6daf4bdde6b92998ddedb125493f779f0a9ec0b61bb2af9ebfd7a7a"} Jun 05 13:24:45.633127 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.633095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b8gbk" event={"ID":"36e7f949-4ced-4d2c-ba2e-7e9d319488ac","Type":"ContainerStarted","Data":"caca7ee3c7a0ce7dcf2e599eea0772b4bfe0d37e3e754762509d79c418fd196e"} Jun 05 13:24:45.634409 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.634380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2prgt" event={"ID":"f96183bd-6921-4969-94c9-a16849fcc848","Type":"ContainerStarted","Data":"43738df0f4963654ebf9918702e5dd282fc44f488856457a3079642ece618b45"} Jun 05 13:24:45.635721 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.635698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" event={"ID":"19e20ac1-a966-417d-a4af-1de0f77c4cfc","Type":"ContainerStarted","Data":"7616bbdb76ab485b6973ad46adfa86acc31f8b3fb187efcf757aa5aa450a5bd9"} Jun 05 13:24:45.644486 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.644466 2565 generic.go:356] "Generic (PLEG): container finished" podID="195a2f0b-8156-45fa-802f-c31fe869e706" containerID="45f61c765f80c397c5f3c40e11538bedbcbd6b22c41e4be37d0dc5839f19965a" exitCode=0 Jun 05 13:24:45.644579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.644497 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerDied","Data":"45f61c765f80c397c5f3c40e11538bedbcbd6b22c41e4be37d0dc5839f19965a"} Jun 05 13:24:45.646528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.646494 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wm82f" podStartSLOduration=2.750596322 podStartE2EDuration="21.646482807s" totalImagesPullingTime="18.895886485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:45.646058274 +0000 UTC m=+24.590352574" watchObservedRunningTime="2026-06-05 13:24:45.646482807 +0000 UTC m=+24.590777115" Jun 05 13:24:45.646596 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.646558 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal" podStartSLOduration=21.646554277 podStartE2EDuration="21.646554277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:27.60845698 +0000 UTC m=+6.552751293" watchObservedRunningTime="2026-06-05 13:24:45.646554277 +0000 UTC m=+24.590848586" Jun 05 13:24:45.662546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.662507 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gsz5v" podStartSLOduration=2.7523992059999998 podStartE2EDuration="21.662494238s" totalImagesPullingTime="18.910095032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:45.661884613 +0000 UTC m=+24.606178936" watchObservedRunningTime="2026-06-05 13:24:45.662494238 +0000 UTC m=+24.606788546" Jun 05 13:24:45.702648 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.702605 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6gbvv" podStartSLOduration=2.772961896 podStartE2EDuration="21.702590881s" totalImagesPullingTime="18.929628985s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:45.702164548 +0000 UTC m=+24.646458862" watchObservedRunningTime="2026-06-05 13:24:45.702590881 +0000 UTC m=+24.646885190" Jun 05 13:24:45.720728 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.720649 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2prgt" podStartSLOduration=2.761016771 podStartE2EDuration="21.72063467s" totalImagesPullingTime="18.959617899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:45.720281404 +0000 UTC m=+24.664575712" watchObservedRunningTime="2026-06-05 13:24:45.72063467 +0000 UTC m=+24.664928979" Jun 05 13:24:45.736963 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:45.736912 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b8gbk" podStartSLOduration=1.867561668 podStartE2EDuration="20.736896753s" totalImagesPullingTime="18.869335085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:45.736762262 +0000 UTC m=+24.681056571" watchObservedRunningTime="2026-06-05 13:24:45.736896753 +0000 UTC m=+24.681191062" Jun 05 13:24:46.283163 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.283137 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 13:24:46.462909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.462808 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T13:24:46.28315523Z","UUID":"b1d98592-3068-453f-8516-beb939a4eaa3","Handler":null,"Name":"","Endpoint":""} Jun 05 13:24:46.464601 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.464576 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 13:24:46.464732 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.464628 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 13:24:46.648465 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.648432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" event={"ID":"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b","Type":"ContainerStarted","Data":"69b1486e6b2503c94f86011af9eea56dff398770c8dc84aff1b2542b7edef10e"} Jun 05 13:24:46.649859 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.649828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lkb84" event={"ID":"2720b512-e1b7-47d4-ac4b-505e68f9cb4c","Type":"ContainerStarted","Data":"546af5f51ae2e9b67f9d7578f30a9c4d9b3e508ffeb2939cbaacabdc6d6cead6"} Jun 05 13:24:46.664504 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:46.664441 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lkb84" podStartSLOduration=3.746342454 podStartE2EDuration="22.664424995s" totalImagesPullingTime="18.918082541s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:46.664058969 +0000 UTC m=+25.608353276" watchObservedRunningTime="2026-06-05 13:24:46.664424995 +0000 UTC m=+25.608719306" Jun 05 13:24:47.458604 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:47.458526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:47.458806 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:47.458526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:47.458806 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:47.458699 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:47.458806 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:47.458783 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:47.458960 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:47.458550 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:47.458960 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:47.458879 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:47.654603 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:47.654526 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" event={"ID":"b33085e5-2ec6-4bdc-90ff-fa9f15002d4b","Type":"ContainerStarted","Data":"657b5e7780546740463ebea581b4aa42f802b39431725935f2ca4f88b0057fcb"} Jun 05 13:24:47.658288 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:47.658264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"866eb8994e43cfa684dcb4f5f261f0ff8ede9021ad76e4ea321a30082fa03d9f"} Jun 05 13:24:47.671953 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:47.671910 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zxlgq" podStartSLOduration=2.543121651 podStartE2EDuration="23.671897367s" totalImagesPullingTime="21.128775716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:47.671537156 +0000 UTC m=+26.615831511" watchObservedRunningTime="2026-06-05 13:24:47.671897367 +0000 UTC m=+26.616191706" Jun 05 13:24:49.310019 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.309982 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:49.310706 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.310689 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:49.458541 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.458387 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:49.458665 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.458406 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:49.458665 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:49.458633 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:49.458777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.458453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:49.458777 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:49.458743 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:49.458873 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:49.458809 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:49.662380 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.662298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:49.662785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:49.662766 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:24:50.666671 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:50.666595 2565 generic.go:356] "Generic (PLEG): container finished" podID="195a2f0b-8156-45fa-802f-c31fe869e706" containerID="ce185ad1ba3ae75748a2c82a3bcf973b65f101fb4f2ea8e8c8f7b88cd48ceebb" exitCode=0 Jun 05 13:24:50.667417 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:50.666685 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerDied","Data":"ce185ad1ba3ae75748a2c82a3bcf973b65f101fb4f2ea8e8c8f7b88cd48ceebb"} Jun 05 13:24:50.670255 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:50.670225 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" event={"ID":"bfb2ef31-70ea-424d-a920-baed0b742420","Type":"ContainerStarted","Data":"90b5cfb30c58f1e6754a110a9f8835ef7b72c8f9688971104d393ca6b26d7124"} Jun 05 13:24:50.737878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:50.737836 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" podStartSLOduration=7.791852835 podStartE2EDuration="26.737822789s" totalImagesPullingTime="18.945969954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:24:50.737343595 +0000 UTC m=+29.681637905" watchObservedRunningTime="2026-06-05 13:24:50.737822789 +0000 UTC m=+29.682117098" Jun 05 13:24:51.459189 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.458996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:51.459459 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.459085 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:51.459459 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.459125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:51.459459 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:51.459323 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:51.459459 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:51.459400 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:51.459697 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:51.459479 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:51.672712 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.672685 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 13:24:51.673076 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.673050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:51.673201 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.673137 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:51.688543 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.688523 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:51.688653 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:51.688621 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:52.057681 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.055826 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-prc6s"] Jun 05 13:24:52.057681 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.056002 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:52.057681 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:52.056148 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:52.058889 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.058863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2xjfw"] Jun 05 13:24:52.059012 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.058971 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:52.059142 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:52.059118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:52.059513 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.059492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wbcds"] Jun 05 13:24:52.059603 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.059590 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:52.059710 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:52.059690 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:52.676486 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.676454 2565 generic.go:356] "Generic (PLEG): container finished" podID="195a2f0b-8156-45fa-802f-c31fe869e706" containerID="eb0741ae8179632b708319d1e590da424e7d260d81ad144199a4f9a7099fdc97" exitCode=0 Jun 05 13:24:52.676956 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.676539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerDied","Data":"eb0741ae8179632b708319d1e590da424e7d260d81ad144199a4f9a7099fdc97"} Jun 05 13:24:52.676956 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:52.676629 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 13:24:53.458279 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:53.458247 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:53.458479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:53.458254 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:53.458479 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:53.458385 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:53.458479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:53.458254 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:53.458643 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:53.458491 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:53.458643 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:53.458567 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:53.679151 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:53.679133 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 13:24:54.324529 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:54.324441 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:24:54.683596 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:54.683504 2565 generic.go:356] "Generic (PLEG): container finished" podID="195a2f0b-8156-45fa-802f-c31fe869e706" containerID="21cfe053d4349f13c5d94338e5e16e339c1e514a28a0d53f5420454bfb4f520d" exitCode=0 Jun 05 13:24:54.683596 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:54.683576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerDied","Data":"21cfe053d4349f13c5d94338e5e16e339c1e514a28a0d53f5420454bfb4f520d"} Jun 05 13:24:55.459140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:55.459099 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:55.459332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:55.459099 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:55.459332 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:55.459220 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:55.459459 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:55.459340 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:55.459459 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:55.459102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:55.459684 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:55.459459 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:57.167143 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:57.167112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:57.167594 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:57.167172 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:57.167594 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.167277 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:57.167594 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.167285 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:57.167594 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.167333 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:29.167319276 +0000 UTC m=+68.111613564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 13:24:57.167594 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.167346 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret podName:bec4494e-a2eb-4c16-bd6b-56586ced9c9a nodeName:}" failed. No retries permitted until 2026-06-05 13:25:29.167340206 +0000 UTC m=+68.111634493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret") pod "global-pull-secret-syncer-2xjfw" (UID: "bec4494e-a2eb-4c16-bd6b-56586ced9c9a") : object "kube-system"/"original-pull-secret" not registered Jun 05 13:24:57.368987 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:57.368958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:57.369305 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.369159 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 13:24:57.369305 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.369181 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 13:24:57.369305 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.369191 2565 projected.go:196] Error preparing data for projected volume kube-api-access-8d2xm for pod openshift-network-diagnostics/network-check-target-prc6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:57.369305 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.369243 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm podName:8e95feff-2a72-449a-ae49-708b67812bf9 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:29.369228284 +0000 UTC m=+68.313522594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8d2xm" (UniqueName: "kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm") pod "network-check-target-prc6s" (UID: "8e95feff-2a72-449a-ae49-708b67812bf9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 13:24:57.458564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:57.458535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:57.458737 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:57.458540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:57.458737 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.458664 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:24:57.458858 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.458735 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2xjfw" podUID="bec4494e-a2eb-4c16-bd6b-56586ced9c9a" Jun 05 13:24:57.458858 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:57.458549 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:57.458858 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:57.458817 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-prc6s" podUID="8e95feff-2a72-449a-ae49-708b67812bf9" Jun 05 13:24:58.373283 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.373254 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-213.ec2.internal" event="NodeReady" Jun 05 13:24:58.373690 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.373400 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 13:24:58.417755 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.417723 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-567d487c66-7htk2"] Jun 05 13:24:58.420277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.420223 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.422915 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.422887 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 13:24:58.423019 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.422910 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 13:24:58.423019 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.422915 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7c9n\"" Jun 05 13:24:58.423019 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.422975 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 13:24:58.431441 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.431416 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 13:24:58.432912 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.432877 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567d487c66-7htk2"] Jun 05 13:24:58.436290 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.436260 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p89jk"] Jun 05 13:24:58.438172 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.438154 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qvmzq"] Jun 05 13:24:58.438312 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.438292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.440048 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.440017 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.440889 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.440758 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 13:24:58.440889 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.440763 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 13:24:58.440889 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.440820 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 13:24:58.441107 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.441090 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2xqv6\"" Jun 05 13:24:58.442250 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.442214 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 13:24:58.442375 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.442223 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 13:24:58.442582 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.442565 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cwhcz\"" Jun 05 13:24:58.447649 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.447628 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p89jk"] Jun 05 13:24:58.450532 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.450514 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvmzq"] Jun 05 13:24:58.477822 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.477954 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66c3cf0f-dab9-458a-b4e6-4617d28196e6-cert\") pod \"ingress-canary-p89jk\" (UID: \"66c3cf0f-dab9-458a-b4e6-4617d28196e6\") " pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.477954 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-certificates\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.477954 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-installation-pull-secrets\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.477954 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-bound-sa-token\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.477954 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9472347-824d-43fe-b6a1-b53685f25aa0-config-volume\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9472347-824d-43fe-b6a1-b53685f25aa0-tmp-dir\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.477981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5089e0d-5589-46ad-8cc9-613350e6a6a5-ca-trust-extracted\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.478004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb9fq\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-kube-api-access-tb9fq\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.478055 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh7fl\" (UniqueName: \"kubernetes.io/projected/b9472347-824d-43fe-b6a1-b53685f25aa0-kube-api-access-bh7fl\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.478114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-trusted-ca\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.478136 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsvw\" (UniqueName: \"kubernetes.io/projected/66c3cf0f-dab9-458a-b4e6-4617d28196e6-kube-api-access-8dsvw\") pod \"ingress-canary-p89jk\" (UID: \"66c3cf0f-dab9-458a-b4e6-4617d28196e6\") " pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.478197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-image-registry-private-configuration\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.478228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.478221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.575342 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.575273 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:24:58.579132 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66c3cf0f-dab9-458a-b4e6-4617d28196e6-cert\") pod \"ingress-canary-p89jk\" (UID: \"66c3cf0f-dab9-458a-b4e6-4617d28196e6\") " pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.579277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-certificates\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-installation-pull-secrets\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-bound-sa-token\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9472347-824d-43fe-b6a1-b53685f25aa0-config-volume\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9472347-824d-43fe-b6a1-b53685f25aa0-tmp-dir\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:58.579269 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5089e0d-5589-46ad-8cc9-613350e6a6a5-ca-trust-extracted\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:58.579333 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb9fq\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-kube-api-access-tb9fq\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7fl\" (UniqueName: \"kubernetes.io/projected/b9472347-824d-43fe-b6a1-b53685f25aa0-kube-api-access-bh7fl\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:58.579409 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:59.079386501 +0000 UTC m=+38.023680804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-trusted-ca\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579528 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsvw\" (UniqueName: \"kubernetes.io/projected/66c3cf0f-dab9-458a-b4e6-4617d28196e6-kube-api-access-8dsvw\") pod \"ingress-canary-p89jk\" (UID: \"66c3cf0f-dab9-458a-b4e6-4617d28196e6\") " pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.579926 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-image-registry-private-configuration\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.579926 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.579926 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:58.579709 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:24:58.580076 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:58.579959 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:24:59.079941168 +0000 UTC m=+38.024235455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:24:58.580076 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.579854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5089e0d-5589-46ad-8cc9-613350e6a6a5-ca-trust-extracted\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.580076 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.580011 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9472347-824d-43fe-b6a1-b53685f25aa0-config-volume\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.580249 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.580084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-certificates\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.580308 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.580289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9472347-824d-43fe-b6a1-b53685f25aa0-tmp-dir\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.580672 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.580645 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-trusted-ca\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.583774 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.583755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-installation-pull-secrets\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.583882 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.583755 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-image-registry-private-configuration\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.583882 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.583842 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66c3cf0f-dab9-458a-b4e6-4617d28196e6-cert\") pod \"ingress-canary-p89jk\" (UID: \"66c3cf0f-dab9-458a-b4e6-4617d28196e6\") " pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.597765 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.597743 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsvw\" (UniqueName: \"kubernetes.io/projected/66c3cf0f-dab9-458a-b4e6-4617d28196e6-kube-api-access-8dsvw\") pod \"ingress-canary-p89jk\" (UID: \"66c3cf0f-dab9-458a-b4e6-4617d28196e6\") " pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:58.597855 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.597806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7fl\" (UniqueName: \"kubernetes.io/projected/b9472347-824d-43fe-b6a1-b53685f25aa0-kube-api-access-bh7fl\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:58.598093 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.598072 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb9fq\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-kube-api-access-tb9fq\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.601645 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.601628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-bound-sa-token\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:58.658513 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.658481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:24:58.748864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:58.748828 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p89jk" Jun 05 13:24:59.083282 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.083192 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:24:59.083282 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.083264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:24:59.083503 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:59.083355 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:24:59.083503 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:59.083357 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:24:59.083503 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:59.083367 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:24:59.083503 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:59.083460 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:00.08344032 +0000 UTC m=+39.027734618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:24:59.083503 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:24:59.083502 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:00.083484316 +0000 UTC m=+39.027778624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:24:59.275489 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.275464 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p89jk"] Jun 05 13:24:59.278731 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:24:59.278707 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c3cf0f_dab9_458a_b4e6_4617d28196e6.slice/crio-f906a262bb5669dffa4cb6745cd705b496435ef11fec3b205041febe2762b5e8 WatchSource:0}: Error finding container f906a262bb5669dffa4cb6745cd705b496435ef11fec3b205041febe2762b5e8: Status 404 returned error can't find the container with id f906a262bb5669dffa4cb6745cd705b496435ef11fec3b205041febe2762b5e8 Jun 05 13:24:59.462246 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.462214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:24:59.462246 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.462236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:24:59.463016 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.462221 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:24:59.468014 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.467985 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:24:59.468014 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.468008 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:24:59.468193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.467985 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:24:59.468193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.468102 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dnbr4\"" Jun 05 13:24:59.468193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.467984 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:24:59.468411 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.468399 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wcdj7\"" Jun 05 13:24:59.697697 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.697668 2565 generic.go:356] "Generic (PLEG): container finished" podID="195a2f0b-8156-45fa-802f-c31fe869e706" containerID="178dd979d8860ac35235967da57138fc79be879383f3d83cbdb310a34b145d45" exitCode=0 Jun 05 13:24:59.697857 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.697733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerDied","Data":"178dd979d8860ac35235967da57138fc79be879383f3d83cbdb310a34b145d45"} Jun 05 13:24:59.698811 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:24:59.698793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p89jk" event={"ID":"66c3cf0f-dab9-458a-b4e6-4617d28196e6","Type":"ContainerStarted","Data":"f906a262bb5669dffa4cb6745cd705b496435ef11fec3b205041febe2762b5e8"} Jun 05 13:25:00.091122 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:00.090879 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:25:00.091122 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:00.091064 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:25:00.091122 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:00.091086 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:25:00.091376 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:00.091163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:25:00.091376 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:00.091231 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:02.09121632 +0000 UTC m=+41.035510606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:25:00.091376 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:00.091291 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:00.091376 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:00.091346 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:02.091328606 +0000 UTC m=+41.035622897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:25:00.704249 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:00.704215 2565 generic.go:356] "Generic (PLEG): container finished" podID="195a2f0b-8156-45fa-802f-c31fe869e706" containerID="9aa30e3df9580044c04737ada0249622ebea4fde8986a461080903ebf30dce3b" exitCode=0 Jun 05 13:25:00.704616 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:00.704264 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerDied","Data":"9aa30e3df9580044c04737ada0249622ebea4fde8986a461080903ebf30dce3b"} Jun 05 13:25:01.709878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:01.709840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" event={"ID":"195a2f0b-8156-45fa-802f-c31fe869e706","Type":"ContainerStarted","Data":"88f3b2d0f4dc6813819eda81119560b58f6cbbfb21b719ea0854e6d392455f94"} Jun 05 13:25:01.710361 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:01.710208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:01.733188 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:01.733140 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m8f7d" podStartSLOduration=11.588645228 podStartE2EDuration="37.733123914s" totalImagesPullingTime="26.144478686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:01.731653386 +0000 UTC m=+40.675947706" watchObservedRunningTime="2026-06-05 13:25:01.733123914 +0000 UTC m=+40.677418207" Jun 05 13:25:01.810542 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:01.810510 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:02.107094 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:02.107051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:25:02.107277 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:02.107143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:25:02.107277 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:02.107182 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:25:02.107277 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:02.107199 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:25:02.107277 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:02.107262 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:06.107246617 +0000 UTC m=+45.051540917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:25:02.107436 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:02.107275 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:02.107436 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:02.107330 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:06.107317531 +0000 UTC m=+45.051611821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:25:02.713257 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:02.713220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p89jk" event={"ID":"66c3cf0f-dab9-458a-b4e6-4617d28196e6","Type":"ContainerStarted","Data":"f5917fa922407d2d86228523f057cc1654c35f499dba074dfc24dbeb460fc7de"} Jun 05 13:25:02.730271 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:02.730226 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p89jk" podStartSLOduration=2.38285628 podStartE2EDuration="4.730210094s" totalImagesPullingTime="2.347353814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:02.729760012 +0000 UTC m=+41.674054322" watchObservedRunningTime="2026-06-05 13:25:02.730210094 +0000 UTC m=+41.674504399" Jun 05 13:25:04.316448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:04.316413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:04.503516 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:04.503483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:04.605538 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:04.605444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:04.675687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:04.675655 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:04.814796 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:04.814764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:04.913338 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:04.913254 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" limit=1024 Jun 05 13:25:06.137416 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:06.137376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:25:06.137795 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:06.137438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:25:06.137795 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:06.137542 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:06.137795 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:06.137602 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:14.137586277 +0000 UTC m=+53.081880567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:25:06.137795 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:06.137553 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:25:06.137795 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:06.137638 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:25:06.137795 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:06.137684 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:14.13767224 +0000 UTC m=+53.081966547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:25:14.200509 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:14.200476 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:25:14.200967 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:14.200526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:25:14.200967 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:14.200616 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:25:14.200967 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:14.200631 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:25:14.200967 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:14.200615 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:14.200967 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:14.200682 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:30.200670119 +0000 UTC m=+69.144964407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:25:14.200967 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:14.200694 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:25:30.200688476 +0000 UTC m=+69.144982763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:25:24.693707 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:24.693678 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gkxkz" Jun 05 13:25:29.205552 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.205504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:25:29.205956 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.205576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:25:29.208577 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.208562 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 13:25:29.208650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.208633 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 13:25:29.216709 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:29.216687 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:25:29.216787 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:29.216740 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:33.216724509 +0000 UTC m=+132.161018800 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : secret "metrics-daemon-secret" not found Jun 05 13:25:29.219706 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.219676 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bec4494e-a2eb-4c16-bd6b-56586ced9c9a-original-pull-secret\") pod \"global-pull-secret-syncer-2xjfw\" (UID: \"bec4494e-a2eb-4c16-bd6b-56586ced9c9a\") " pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:25:29.406875 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.406838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:25:29.409793 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.409779 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 13:25:29.419350 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.419332 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 13:25:29.429670 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.429648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d2xm\" (UniqueName: \"kubernetes.io/projected/8e95feff-2a72-449a-ae49-708b67812bf9-kube-api-access-8d2xm\") pod \"network-check-target-prc6s\" (UID: \"8e95feff-2a72-449a-ae49-708b67812bf9\") " pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:25:29.475150 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.475099 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2xjfw" Jun 05 13:25:29.482408 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.482387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wcdj7\"" Jun 05 13:25:29.489932 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.489908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:25:29.611440 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.611412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2xjfw"] Jun 05 13:25:29.614724 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:25:29.614696 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec4494e_a2eb_4c16_bd6b_56586ced9c9a.slice/crio-bf8d8b3ecc5df2879f281dff5507d6ed56dddabba5c13b47e40dae5cdd976f19 WatchSource:0}: Error finding container bf8d8b3ecc5df2879f281dff5507d6ed56dddabba5c13b47e40dae5cdd976f19: Status 404 returned error can't find the container with id bf8d8b3ecc5df2879f281dff5507d6ed56dddabba5c13b47e40dae5cdd976f19 Jun 05 13:25:29.620010 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.619990 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp"] Jun 05 13:25:29.622236 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.622220 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.624714 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.624680 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 05 13:25:29.624905 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.624891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 05 13:25:29.625833 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.625811 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 05 13:25:29.626288 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.626274 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 05 13:25:29.626875 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.626857 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-prc6s"] Jun 05 13:25:29.629312 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:25:29.629287 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e95feff_2a72_449a_ae49_708b67812bf9.slice/crio-6c5f747e7314f14d5853e5a0c145f02f03838a5ae2f49f4f4ed4a90c1b5743bf WatchSource:0}: Error finding container 6c5f747e7314f14d5853e5a0c145f02f03838a5ae2f49f4f4ed4a90c1b5743bf: Status 404 returned error can't find the container with id 6c5f747e7314f14d5853e5a0c145f02f03838a5ae2f49f4f4ed4a90c1b5743bf Jun 05 13:25:29.633601 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.633581 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp"] Jun 05 13:25:29.709719 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.709692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8b267e1e-1525-40d1-b356-54d7bee91df2-klusterlet-config\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.709848 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.709778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b267e1e-1525-40d1-b356-54d7bee91df2-tmp\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.709848 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.709803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgnn7\" (UniqueName: \"kubernetes.io/projected/8b267e1e-1525-40d1-b356-54d7bee91df2-kube-api-access-rgnn7\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.775770 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.775699 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-prc6s" event={"ID":"8e95feff-2a72-449a-ae49-708b67812bf9","Type":"ContainerStarted","Data":"6c5f747e7314f14d5853e5a0c145f02f03838a5ae2f49f4f4ed4a90c1b5743bf"} Jun 05 13:25:29.776774 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.776754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2xjfw" event={"ID":"bec4494e-a2eb-4c16-bd6b-56586ced9c9a","Type":"ContainerStarted","Data":"bf8d8b3ecc5df2879f281dff5507d6ed56dddabba5c13b47e40dae5cdd976f19"} Jun 05 13:25:29.810246 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.810226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8b267e1e-1525-40d1-b356-54d7bee91df2-klusterlet-config\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.810420 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.810286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b267e1e-1525-40d1-b356-54d7bee91df2-tmp\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.810420 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.810407 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgnn7\" (UniqueName: \"kubernetes.io/projected/8b267e1e-1525-40d1-b356-54d7bee91df2-kube-api-access-rgnn7\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.810615 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.810594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b267e1e-1525-40d1-b356-54d7bee91df2-tmp\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.812817 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.812795 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8b267e1e-1525-40d1-b356-54d7bee91df2-klusterlet-config\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.819213 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.819194 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgnn7\" (UniqueName: \"kubernetes.io/projected/8b267e1e-1525-40d1-b356-54d7bee91df2-kube-api-access-rgnn7\") pod \"klusterlet-addon-workmgr-64bf464564-l88wp\" (UID: \"8b267e1e-1525-40d1-b356-54d7bee91df2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:29.932053 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:29.932014 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:30.052074 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:30.051989 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp"] Jun 05 13:25:30.054994 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:25:30.054950 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b267e1e_1525_40d1_b356_54d7bee91df2.slice/crio-590ab3416f3761096d9784d56c304dde035c56a7f34190a49864b569d5b9acd7 WatchSource:0}: Error finding container 590ab3416f3761096d9784d56c304dde035c56a7f34190a49864b569d5b9acd7: Status 404 returned error can't find the container with id 590ab3416f3761096d9784d56c304dde035c56a7f34190a49864b569d5b9acd7 Jun 05 13:25:30.213188 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:30.213149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:25:30.213587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:30.213229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:25:30.213587 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:30.213280 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:25:30.213587 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:30.213340 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:02.213325491 +0000 UTC m=+101.157619778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:25:30.213587 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:30.213366 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:25:30.213587 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:30.213381 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:25:30.213587 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:25:30.213439 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:26:02.213418995 +0000 UTC m=+101.157713286 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:25:30.781352 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:30.781255 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerStarted","Data":"590ab3416f3761096d9784d56c304dde035c56a7f34190a49864b569d5b9acd7"} Jun 05 13:25:36.798573 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.798540 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-prc6s" event={"ID":"8e95feff-2a72-449a-ae49-708b67812bf9","Type":"ContainerStarted","Data":"d827811c481ae8242505c2c5ad3f3081a23af6d01160a82b0b81beaff9166772"} Jun 05 13:25:36.799003 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.798653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:25:36.800106 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.800079 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2xjfw" event={"ID":"bec4494e-a2eb-4c16-bd6b-56586ced9c9a","Type":"ContainerStarted","Data":"31996fdf3a8e13f37511d0b20028511f5f09f05789f28f6177ee31e29f7c95c6"} Jun 05 13:25:36.801473 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.801453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerStarted","Data":"d1c19f79ec8000080a7870389c32c4bf1683ddbd967ca6bbeadf504e2e055a76"} Jun 05 13:25:36.801629 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.801612 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:36.803111 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.803095 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:25:36.816483 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.816446 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-prc6s" podStartSLOduration=66.048199269 podStartE2EDuration="1m12.816434719s" totalImagesPullingTime="6.76823545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:36.815614792 +0000 UTC m=+75.759909091" watchObservedRunningTime="2026-06-05 13:25:36.816434719 +0000 UTC m=+75.760729006" Jun 05 13:25:36.836549 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.836418 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podStartSLOduration=1.469865653 podStartE2EDuration="7.836402198s" totalImagesPullingTime="6.366536545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:36.835769736 +0000 UTC m=+75.780064045" watchObservedRunningTime="2026-06-05 13:25:36.836402198 +0000 UTC m=+75.780696507" Jun 05 13:25:36.853815 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:25:36.853780 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2xjfw" podStartSLOduration=66.057776236 podStartE2EDuration="1m12.853771637s" totalImagesPullingTime="6.795995401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:25:36.853356993 +0000 UTC m=+75.797651304" watchObservedRunningTime="2026-06-05 13:25:36.853771637 +0000 UTC m=+75.798065946" Jun 05 13:26:02.226288 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:26:02.226256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:26:02.226691 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:26:02.226302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:26:02.226691 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:02.226388 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:26:02.226691 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:02.226403 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:26:02.226691 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:02.226386 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:26:02.226691 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:02.226458 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:06.226444449 +0000 UTC m=+165.170738740 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:26:02.226691 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:02.226471 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:06.226465554 +0000 UTC m=+165.170759840 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:26:07.806082 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:26:07.806051 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-prc6s" Jun 05 13:26:33.236112 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:26:33.236074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:26:33.236577 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:33.236220 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 13:26:33.236577 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:26:33.236295 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs podName:b1f6139d-854e-43a5-ab53-4c0689e9abe3 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:35.236279055 +0000 UTC m=+254.180573341 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs") pod "network-metrics-daemon-wbcds" (UID: "b1f6139d-854e-43a5-ab53-4c0689e9abe3") : secret "metrics-daemon-secret" not found Jun 05 13:27:01.434976 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:01.434924 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" Jun 05 13:27:01.456109 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:01.456079 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qvmzq" podUID="b9472347-824d-43fe-b6a1-b53685f25aa0" Jun 05 13:27:02.001632 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:02.001600 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:27:02.001632 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:02.001640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvmzq" Jun 05 13:27:02.484824 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:02.484784 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wbcds" podUID="b1f6139d-854e-43a5-ab53-4c0689e9abe3" Jun 05 13:27:06.257670 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:06.257618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:27:06.258194 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:06.257691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:27:06.258194 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:06.257783 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 13:27:06.258194 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:06.257848 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls podName:b9472347-824d-43fe-b6a1-b53685f25aa0 nodeName:}" failed. No retries permitted until 2026-06-05 13:29:08.257833377 +0000 UTC m=+287.202127664 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls") pod "dns-default-qvmzq" (UID: "b9472347-824d-43fe-b6a1-b53685f25aa0") : secret "dns-default-metrics-tls" not found Jun 05 13:27:06.258194 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:06.257788 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 13:27:06.258194 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:06.257895 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-567d487c66-7htk2: secret "image-registry-tls" not found Jun 05 13:27:06.258194 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:06.257953 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls podName:d5089e0d-5589-46ad-8cc9-613350e6a6a5 nodeName:}" failed. No retries permitted until 2026-06-05 13:29:08.257935371 +0000 UTC m=+287.202229672 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls") pod "image-registry-567d487c66-7htk2" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5") : secret "image-registry-tls" not found Jun 05 13:27:16.459250 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:16.459146 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:27:36.802452 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:36.802367 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 05 13:27:37.086214 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:37.086150 2565 generic.go:356] "Generic (PLEG): container finished" podID="8b267e1e-1525-40d1-b356-54d7bee91df2" containerID="d1c19f79ec8000080a7870389c32c4bf1683ddbd967ca6bbeadf504e2e055a76" exitCode=1 Jun 05 13:27:37.086334 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:37.086223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerDied","Data":"d1c19f79ec8000080a7870389c32c4bf1683ddbd967ca6bbeadf504e2e055a76"} Jun 05 13:27:37.086546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:37.086532 2565 scope.go:117] "RemoveContainer" containerID="d1c19f79ec8000080a7870389c32c4bf1683ddbd967ca6bbeadf504e2e055a76" Jun 05 13:27:38.090825 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:38.090794 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerStarted","Data":"f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93"} Jun 05 13:27:38.091272 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:38.091054 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:27:38.091695 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:38.091674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:27:52.556479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.556447 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc"] Jun 05 13:27:52.558524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.558506 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-c8x6s"] Jun 05 13:27:52.558629 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.558617 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.560197 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.560181 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-kp4xl"] Jun 05 13:27:52.560327 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.560309 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.561161 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.561144 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 13:27:52.561606 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.561588 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.561687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.561589 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.562913 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.562893 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.563522 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.563506 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8g5zb\"" Jun 05 13:27:52.563600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.563551 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 13:27:52.564367 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.564348 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 13:27:52.564472 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.564395 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vthgq\"" Jun 05 13:27:52.564472 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.564348 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.564472 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.564460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.565855 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.565833 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 13:27:52.565941 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.565901 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 13:27:52.566378 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.566363 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 13:27:52.566378 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.566374 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 13:27:52.566514 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.566370 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9c4z5\"" Jun 05 13:27:52.566514 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.566408 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 13:27:52.570418 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.570400 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 13:27:52.573688 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.573672 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 13:27:52.575671 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.575591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-kp4xl"] Jun 05 13:27:52.576499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.576483 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc"] Jun 05 13:27:52.577511 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.577494 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-c8x6s"] Jun 05 13:27:52.650604 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff312463-178f-43ba-91b9-de02fdca5fe2-config\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.650703 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de1a44ff-8385-42ff-9354-4afd1be39b12-tmp\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.650703 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1a44ff-8385-42ff-9354-4afd1be39b12-trusted-ca-bundle\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.650703 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff312463-178f-43ba-91b9-de02fdca5fe2-serving-cert\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.650703 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjsw8\" (UniqueName: \"kubernetes.io/projected/de1a44ff-8385-42ff-9354-4afd1be39b12-kube-api-access-pjsw8\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.650864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff312463-178f-43ba-91b9-de02fdca5fe2-trusted-ca\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.650864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1a44ff-8385-42ff-9354-4afd1be39b12-service-ca-bundle\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.650864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.650864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnhzl\" (UniqueName: \"kubernetes.io/projected/ff312463-178f-43ba-91b9-de02fdca5fe2-kube-api-access-xnhzl\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.650864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9xkt\" (UniqueName: \"kubernetes.io/projected/e765b3f4-cf59-4e58-bf2b-195f98feaed0-kube-api-access-w9xkt\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.651011 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e765b3f4-cf59-4e58-bf2b-195f98feaed0-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.651011 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de1a44ff-8385-42ff-9354-4afd1be39b12-serving-cert\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.651011 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.650960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de1a44ff-8385-42ff-9354-4afd1be39b12-snapshots\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.751593 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e765b3f4-cf59-4e58-bf2b-195f98feaed0-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.751704 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de1a44ff-8385-42ff-9354-4afd1be39b12-serving-cert\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.751704 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de1a44ff-8385-42ff-9354-4afd1be39b12-snapshots\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.751821 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff312463-178f-43ba-91b9-de02fdca5fe2-config\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.751821 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de1a44ff-8385-42ff-9354-4afd1be39b12-tmp\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.751941 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1a44ff-8385-42ff-9354-4afd1be39b12-trusted-ca-bundle\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.751995 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff312463-178f-43ba-91b9-de02fdca5fe2-serving-cert\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.752074 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.751988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjsw8\" (UniqueName: \"kubernetes.io/projected/de1a44ff-8385-42ff-9354-4afd1be39b12-kube-api-access-pjsw8\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.752074 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff312463-178f-43ba-91b9-de02fdca5fe2-trusted-ca\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.752074 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1a44ff-8385-42ff-9354-4afd1be39b12-service-ca-bundle\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.752234 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.752234 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnhzl\" (UniqueName: \"kubernetes.io/projected/ff312463-178f-43ba-91b9-de02fdca5fe2-kube-api-access-xnhzl\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.752234 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9xkt\" (UniqueName: \"kubernetes.io/projected/e765b3f4-cf59-4e58-bf2b-195f98feaed0-kube-api-access-w9xkt\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.752234 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752143 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de1a44ff-8385-42ff-9354-4afd1be39b12-tmp\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.752234 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752219 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/de1a44ff-8385-42ff-9354-4afd1be39b12-snapshots\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.752476 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752447 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e765b3f4-cf59-4e58-bf2b-195f98feaed0-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.752531 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff312463-178f-43ba-91b9-de02fdca5fe2-config\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.752621 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:52.752598 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:52.752695 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:52.752677 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls podName:e765b3f4-cf59-4e58-bf2b-195f98feaed0 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:53.252659213 +0000 UTC m=+212.196953513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4lltc" (UID: "e765b3f4-cf59-4e58-bf2b-195f98feaed0") : secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:52.752847 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752821 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1a44ff-8385-42ff-9354-4afd1be39b12-service-ca-bundle\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.752929 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.752881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff312463-178f-43ba-91b9-de02fdca5fe2-trusted-ca\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.753074 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.753055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de1a44ff-8385-42ff-9354-4afd1be39b12-trusted-ca-bundle\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.754264 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.754247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de1a44ff-8385-42ff-9354-4afd1be39b12-serving-cert\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.754385 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.754371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff312463-178f-43ba-91b9-de02fdca5fe2-serving-cert\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.761135 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.761114 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnhzl\" (UniqueName: \"kubernetes.io/projected/ff312463-178f-43ba-91b9-de02fdca5fe2-kube-api-access-xnhzl\") pod \"console-operator-668fdbf85c-c8x6s\" (UID: \"ff312463-178f-43ba-91b9-de02fdca5fe2\") " pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.761382 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.761364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9xkt\" (UniqueName: \"kubernetes.io/projected/e765b3f4-cf59-4e58-bf2b-195f98feaed0-kube-api-access-w9xkt\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:52.761480 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.761460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjsw8\" (UniqueName: \"kubernetes.io/projected/de1a44ff-8385-42ff-9354-4afd1be39b12-kube-api-access-pjsw8\") pod \"insights-operator-896549976-kp4xl\" (UID: \"de1a44ff-8385-42ff-9354-4afd1be39b12\") " pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:52.876315 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.876251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:27:52.881869 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:52.881852 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-kp4xl" Jun 05 13:27:53.005355 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:53.005328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-c8x6s"] Jun 05 13:27:53.008312 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:27:53.008282 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff312463_178f_43ba_91b9_de02fdca5fe2.slice/crio-c69bfffccf4874c990d3b2601cc238b8e536d48f723ca625367386f2a953ac26 WatchSource:0}: Error finding container c69bfffccf4874c990d3b2601cc238b8e536d48f723ca625367386f2a953ac26: Status 404 returned error can't find the container with id c69bfffccf4874c990d3b2601cc238b8e536d48f723ca625367386f2a953ac26 Jun 05 13:27:53.020963 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:53.020943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-kp4xl"] Jun 05 13:27:53.023507 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:27:53.023484 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1a44ff_8385_42ff_9354_4afd1be39b12.slice/crio-4eeab525c4536ac472047ae95bec4c88b3a63a8201a168c9aafe058dd26412ad WatchSource:0}: Error finding container 4eeab525c4536ac472047ae95bec4c88b3a63a8201a168c9aafe058dd26412ad: Status 404 returned error can't find the container with id 4eeab525c4536ac472047ae95bec4c88b3a63a8201a168c9aafe058dd26412ad Jun 05 13:27:53.136195 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:53.136132 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" event={"ID":"ff312463-178f-43ba-91b9-de02fdca5fe2","Type":"ContainerStarted","Data":"c69bfffccf4874c990d3b2601cc238b8e536d48f723ca625367386f2a953ac26"} Jun 05 13:27:53.137151 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:53.137126 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kp4xl" event={"ID":"de1a44ff-8385-42ff-9354-4afd1be39b12","Type":"ContainerStarted","Data":"4eeab525c4536ac472047ae95bec4c88b3a63a8201a168c9aafe058dd26412ad"} Jun 05 13:27:53.256979 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:53.256958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:53.257150 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:53.257134 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:53.257206 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:53.257197 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls podName:e765b3f4-cf59-4e58-bf2b-195f98feaed0 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:54.25717603 +0000 UTC m=+213.201470324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4lltc" (UID: "e765b3f4-cf59-4e58-bf2b-195f98feaed0") : secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:54.264021 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:54.263978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:54.264463 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:54.264150 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:54.264463 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:54.264222 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls podName:e765b3f4-cf59-4e58-bf2b-195f98feaed0 nodeName:}" failed. No retries permitted until 2026-06-05 13:27:56.264206818 +0000 UTC m=+215.208501105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4lltc" (UID: "e765b3f4-cf59-4e58-bf2b-195f98feaed0") : secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:56.149770 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:56.149677 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kp4xl" event={"ID":"de1a44ff-8385-42ff-9354-4afd1be39b12","Type":"ContainerStarted","Data":"cb0d3921a1622dcb7745f08b8c693ff135b389c74d8ce75ba79ad5d13dc55239"} Jun 05 13:27:56.167107 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:56.167058 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-kp4xl" podStartSLOduration=1.451088685 podStartE2EDuration="4.167024432s" totalImagesPullingTime="2.715935747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:27:56.165380208 +0000 UTC m=+215.109674540" watchObservedRunningTime="2026-06-05 13:27:56.167024432 +0000 UTC m=+215.111318720" Jun 05 13:27:56.281291 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:56.281261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:27:56.281459 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:56.281376 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:56.281459 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:56.281439 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls podName:e765b3f4-cf59-4e58-bf2b-195f98feaed0 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:00.28141864 +0000 UTC m=+219.225712928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4lltc" (UID: "e765b3f4-cf59-4e58-bf2b-195f98feaed0") : secret "cluster-monitoring-operator-tls" not found Jun 05 13:27:57.153574 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:57.153546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/0.log" Jun 05 13:27:57.153932 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:57.153587 2565 generic.go:356] "Generic (PLEG): container finished" podID="ff312463-178f-43ba-91b9-de02fdca5fe2" containerID="4062f8f15caf7d4167f9c24d3e0193b809cb1449849b9348d25dadbe3a72d536" exitCode=255 Jun 05 13:27:57.153932 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:57.153618 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" event={"ID":"ff312463-178f-43ba-91b9-de02fdca5fe2","Type":"ContainerDied","Data":"4062f8f15caf7d4167f9c24d3e0193b809cb1449849b9348d25dadbe3a72d536"} Jun 05 13:27:57.153932 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:57.153822 2565 scope.go:117] "RemoveContainer" containerID="4062f8f15caf7d4167f9c24d3e0193b809cb1449849b9348d25dadbe3a72d536" Jun 05 13:27:58.158368 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.158336 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/1.log" Jun 05 13:27:58.158909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.158777 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/0.log" Jun 05 13:27:58.158909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.158820 2565 generic.go:356] "Generic (PLEG): container finished" podID="ff312463-178f-43ba-91b9-de02fdca5fe2" containerID="950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589" exitCode=255 Jun 05 13:27:58.158909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.158857 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" event={"ID":"ff312463-178f-43ba-91b9-de02fdca5fe2","Type":"ContainerDied","Data":"950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589"} Jun 05 13:27:58.159114 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.158920 2565 scope.go:117] "RemoveContainer" containerID="4062f8f15caf7d4167f9c24d3e0193b809cb1449849b9348d25dadbe3a72d536" Jun 05 13:27:58.159162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.159134 2565 scope.go:117] "RemoveContainer" containerID="950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589" Jun 05 13:27:58.159344 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:58.159319 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-c8x6s_openshift-console-operator(ff312463-178f-43ba-91b9-de02fdca5fe2)\"" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" podUID="ff312463-178f-43ba-91b9-de02fdca5fe2" Jun 05 13:27:58.666667 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:58.666642 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8gbk_36e7f949-4ced-4d2c-ba2e-7e9d319488ac/dns-node-resolver/0.log" Jun 05 13:27:59.125143 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.125113 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-gqs5d"] Jun 05 13:27:59.127547 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.127533 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.132840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.130638 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 13:27:59.132840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.130824 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 13:27:59.132840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.131924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 13:27:59.132840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.132206 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kr4j6\"" Jun 05 13:27:59.132840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.132456 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 13:27:59.137178 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.137155 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-gqs5d"] Jun 05 13:27:59.162795 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.162776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/1.log" Jun 05 13:27:59.163169 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.163121 2565 scope.go:117] "RemoveContainer" containerID="950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589" Jun 05 13:27:59.163307 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:27:59.163287 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-c8x6s_openshift-console-operator(ff312463-178f-43ba-91b9-de02fdca5fe2)\"" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" podUID="ff312463-178f-43ba-91b9-de02fdca5fe2" Jun 05 13:27:59.204165 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.204146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bc7eda2f-0dd5-41a3-818a-aa330ec70685-signing-key\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.204270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.204208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bcw6\" (UniqueName: \"kubernetes.io/projected/bc7eda2f-0dd5-41a3-818a-aa330ec70685-kube-api-access-9bcw6\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.204270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.204230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bc7eda2f-0dd5-41a3-818a-aa330ec70685-signing-cabundle\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.305278 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.305259 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bc7eda2f-0dd5-41a3-818a-aa330ec70685-signing-cabundle\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.305380 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.305325 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bc7eda2f-0dd5-41a3-818a-aa330ec70685-signing-key\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.305437 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.305400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bcw6\" (UniqueName: \"kubernetes.io/projected/bc7eda2f-0dd5-41a3-818a-aa330ec70685-kube-api-access-9bcw6\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.305893 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.305869 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bc7eda2f-0dd5-41a3-818a-aa330ec70685-signing-cabundle\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.307673 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.307656 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bc7eda2f-0dd5-41a3-818a-aa330ec70685-signing-key\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.313256 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.313239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bcw6\" (UniqueName: \"kubernetes.io/projected/bc7eda2f-0dd5-41a3-818a-aa330ec70685-kube-api-access-9bcw6\") pod \"service-ca-7d74d578b8-gqs5d\" (UID: \"bc7eda2f-0dd5-41a3-818a-aa330ec70685\") " pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.438059 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.437978 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" Jun 05 13:27:59.565675 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.565646 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-gqs5d"] Jun 05 13:27:59.568275 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:27:59.568248 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7eda2f_0dd5_41a3_818a_aa330ec70685.slice/crio-b3ee8ec8d2545e46f6af423f6c44d91f62a089dd19c33871b6fc7cb2d083d764 WatchSource:0}: Error finding container b3ee8ec8d2545e46f6af423f6c44d91f62a089dd19c33871b6fc7cb2d083d764: Status 404 returned error can't find the container with id b3ee8ec8d2545e46f6af423f6c44d91f62a089dd19c33871b6fc7cb2d083d764 Jun 05 13:27:59.866454 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:27:59.866426 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wm82f_00848e40-2fdf-4321-a336-e8363b12c652/node-ca/0.log" Jun 05 13:28:00.167809 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:00.167726 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" event={"ID":"bc7eda2f-0dd5-41a3-818a-aa330ec70685","Type":"ContainerStarted","Data":"b3ee8ec8d2545e46f6af423f6c44d91f62a089dd19c33871b6fc7cb2d083d764"} Jun 05 13:28:00.314052 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:00.314003 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:28:00.314229 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:00.314141 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 13:28:00.314229 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:00.314211 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls podName:e765b3f4-cf59-4e58-bf2b-195f98feaed0 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:08.314195413 +0000 UTC m=+227.258489704 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4lltc" (UID: "e765b3f4-cf59-4e58-bf2b-195f98feaed0") : secret "cluster-monitoring-operator-tls" not found Jun 05 13:28:00.866738 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:00.866715 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p89jk_66c3cf0f-dab9-458a-b4e6-4617d28196e6/serve-healthcheck-canary/0.log" Jun 05 13:28:02.175400 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:02.175365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" event={"ID":"bc7eda2f-0dd5-41a3-818a-aa330ec70685","Type":"ContainerStarted","Data":"dc2ffab5c65d919b7da3a79b883d1f95e93773be645c843fbc0f7d3c31341fd8"} Jun 05 13:28:02.191135 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:02.191093 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-gqs5d" podStartSLOduration=1.5364460370000002 podStartE2EDuration="3.191078741s" totalImagesPullingTime="1.654632704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:02.190540366 +0000 UTC m=+221.134834676" watchObservedRunningTime="2026-06-05 13:28:02.191078741 +0000 UTC m=+221.135373049" Jun 05 13:28:02.877029 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:02.876944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:28:02.877029 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:02.876995 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:28:02.877348 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:02.877336 2565 scope.go:117] "RemoveContainer" containerID="950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589" Jun 05 13:28:02.877517 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:02.877498 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-c8x6s_openshift-console-operator(ff312463-178f-43ba-91b9-de02fdca5fe2)\"" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" podUID="ff312463-178f-43ba-91b9-de02fdca5fe2" Jun 05 13:28:08.375992 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:08.375956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:28:08.376393 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:08.376108 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 13:28:08.376393 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:08.376172 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls podName:e765b3f4-cf59-4e58-bf2b-195f98feaed0 nodeName:}" failed. No retries permitted until 2026-06-05 13:28:24.376156565 +0000 UTC m=+243.320450855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-4lltc" (UID: "e765b3f4-cf59-4e58-bf2b-195f98feaed0") : secret "cluster-monitoring-operator-tls" not found Jun 05 13:28:16.458736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:16.458702 2565 scope.go:117] "RemoveContainer" containerID="950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589" Jun 05 13:28:17.216955 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:17.216930 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:28:17.217300 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:17.217287 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/1.log" Jun 05 13:28:17.217361 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:17.217317 2565 generic.go:356] "Generic (PLEG): container finished" podID="ff312463-178f-43ba-91b9-de02fdca5fe2" containerID="5a5f948516416f848b49b5edddd0f5c9e77642db2f108706bc1282f57d223589" exitCode=255 Jun 05 13:28:17.217361 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:17.217350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" event={"ID":"ff312463-178f-43ba-91b9-de02fdca5fe2","Type":"ContainerDied","Data":"5a5f948516416f848b49b5edddd0f5c9e77642db2f108706bc1282f57d223589"} Jun 05 13:28:17.217456 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:17.217390 2565 scope.go:117] "RemoveContainer" containerID="950c1187defeaf9897fee6ff6508fcac779b6329881fdf4325087a9aa4da6589" Jun 05 13:28:17.217704 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:17.217687 2565 scope.go:117] "RemoveContainer" containerID="5a5f948516416f848b49b5edddd0f5c9e77642db2f108706bc1282f57d223589" Jun 05 13:28:17.217897 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:17.217868 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-c8x6s_openshift-console-operator(ff312463-178f-43ba-91b9-de02fdca5fe2)\"" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" podUID="ff312463-178f-43ba-91b9-de02fdca5fe2" Jun 05 13:28:18.222449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:18.222420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:28:22.877006 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:22.876966 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:28:22.877397 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:22.877027 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:28:22.877397 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:22.877352 2565 scope.go:117] "RemoveContainer" containerID="5a5f948516416f848b49b5edddd0f5c9e77642db2f108706bc1282f57d223589" Jun 05 13:28:22.877529 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:28:22.877508 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-c8x6s_openshift-console-operator(ff312463-178f-43ba-91b9-de02fdca5fe2)\"" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" podUID="ff312463-178f-43ba-91b9-de02fdca5fe2" Jun 05 13:28:24.393148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:24.393107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:28:24.395447 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:24.395429 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e765b3f4-cf59-4e58-bf2b-195f98feaed0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-4lltc\" (UID: \"e765b3f4-cf59-4e58-bf2b-195f98feaed0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:28:24.672028 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:24.671959 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8g5zb\"" Jun 05 13:28:24.679196 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:24.679176 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" Jun 05 13:28:24.795029 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:24.794908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc"] Jun 05 13:28:24.797309 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:28:24.797284 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode765b3f4_cf59_4e58_bf2b_195f98feaed0.slice/crio-92590334a163cae6356e25c77aecd4efa3ff41219a4b17005e72707940f1232a WatchSource:0}: Error finding container 92590334a163cae6356e25c77aecd4efa3ff41219a4b17005e72707940f1232a: Status 404 returned error can't find the container with id 92590334a163cae6356e25c77aecd4efa3ff41219a4b17005e72707940f1232a Jun 05 13:28:25.246918 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:25.246876 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" event={"ID":"e765b3f4-cf59-4e58-bf2b-195f98feaed0","Type":"ContainerStarted","Data":"92590334a163cae6356e25c77aecd4efa3ff41219a4b17005e72707940f1232a"} Jun 05 13:28:27.255355 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:27.255315 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" event={"ID":"e765b3f4-cf59-4e58-bf2b-195f98feaed0","Type":"ContainerStarted","Data":"d8ef6b2d4f1bd5c71b4b98d05590d01f894fbc5b4a788cbd7e4dd55852bc3549"} Jun 05 13:28:27.271453 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:27.271401 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-4lltc" podStartSLOduration=33.715114218 podStartE2EDuration="35.271384036s" totalImagesPullingTime="1.556269818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:27.270567482 +0000 UTC m=+246.214861796" watchObservedRunningTime="2026-06-05 13:28:27.271384036 +0000 UTC m=+246.215678346" Jun 05 13:28:35.268793 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:35.268762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:28:35.270987 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:35.270961 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1f6139d-854e-43a5-ab53-4c0689e9abe3-metrics-certs\") pod \"network-metrics-daemon-wbcds\" (UID: \"b1f6139d-854e-43a5-ab53-4c0689e9abe3\") " pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:28:35.362854 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:35.362829 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dnbr4\"" Jun 05 13:28:35.370430 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:35.370412 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wbcds" Jun 05 13:28:35.485534 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:35.485445 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wbcds"] Jun 05 13:28:35.487909 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:28:35.487882 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f6139d_854e_43a5_ab53_4c0689e9abe3.slice/crio-0ede3e7674e925bf83e78d924c6bda6fd313de81b7412bc5c8e84aebe75feb77 WatchSource:0}: Error finding container 0ede3e7674e925bf83e78d924c6bda6fd313de81b7412bc5c8e84aebe75feb77: Status 404 returned error can't find the container with id 0ede3e7674e925bf83e78d924c6bda6fd313de81b7412bc5c8e84aebe75feb77 Jun 05 13:28:36.282141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:36.282106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wbcds" event={"ID":"b1f6139d-854e-43a5-ab53-4c0689e9abe3","Type":"ContainerStarted","Data":"0ede3e7674e925bf83e78d924c6bda6fd313de81b7412bc5c8e84aebe75feb77"} Jun 05 13:28:37.286958 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:37.286922 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wbcds" event={"ID":"b1f6139d-854e-43a5-ab53-4c0689e9abe3","Type":"ContainerStarted","Data":"8323590aa7d9eea1d47141622f68ce634ae7602b1127f343b123f61b1e5ea47f"} Jun 05 13:28:37.287406 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:37.287003 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wbcds" event={"ID":"b1f6139d-854e-43a5-ab53-4c0689e9abe3","Type":"ContainerStarted","Data":"257d219ddd92249fbf5d4c3a095c6c4b68469710cad0f5e4cdbb52ed980fca0a"} Jun 05 13:28:37.304438 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:37.304393 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wbcds" podStartSLOduration=252.335211175 podStartE2EDuration="4m13.304378679s" totalImagesPullingTime="969.167504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:37.303493055 +0000 UTC m=+256.247787366" watchObservedRunningTime="2026-06-05 13:28:37.304378679 +0000 UTC m=+256.248672988" Jun 05 13:28:37.458878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:37.458856 2565 scope.go:117] "RemoveContainer" containerID="5a5f948516416f848b49b5edddd0f5c9e77642db2f108706bc1282f57d223589" Jun 05 13:28:38.293938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:38.293913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:28:38.294376 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:38.294053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" event={"ID":"ff312463-178f-43ba-91b9-de02fdca5fe2","Type":"ContainerStarted","Data":"096c1f3c06962aa661a0646b45dfb30b5759c4e472e86589f9fd654505535a70"} Jun 05 13:28:38.294483 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:38.294462 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:28:38.310439 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:38.310389 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" podStartSLOduration=43.010508274 podStartE2EDuration="46.310374429s" totalImagesPullingTime="3.299866155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:28:38.309977883 +0000 UTC m=+257.254272192" watchObservedRunningTime="2026-06-05 13:28:38.310374429 +0000 UTC m=+257.254668762" Jun 05 13:28:38.581353 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:28:38.581280 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-c8x6s" Jun 05 13:29:05.002702 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:29:05.002662 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qvmzq" podUID="b9472347-824d-43fe-b6a1-b53685f25aa0" Jun 05 13:29:05.002702 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:29:05.002689 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" Jun 05 13:29:05.374224 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:05.374148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvmzq" Jun 05 13:29:05.374364 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:05.374148 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:29:08.303461 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.303431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:29:08.303899 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.303488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:29:08.305806 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.305784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9472347-824d-43fe-b6a1-b53685f25aa0-metrics-tls\") pod \"dns-default-qvmzq\" (UID: \"b9472347-824d-43fe-b6a1-b53685f25aa0\") " pod="openshift-dns/dns-default-qvmzq" Jun 05 13:29:08.305865 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.305784 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"image-registry-567d487c66-7htk2\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:29:08.378349 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.378320 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cwhcz\"" Jun 05 13:29:08.378349 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.378320 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7c9n\"" Jun 05 13:29:08.385123 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.385100 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:29:08.385241 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.385233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvmzq" Jun 05 13:29:08.521437 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.521394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvmzq"] Jun 05 13:29:08.524150 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:29:08.524124 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9472347_824d_43fe_b6a1_b53685f25aa0.slice/crio-05e4d01548669790ea30394cac50c76ef301524f09270e52372139b526a38913 WatchSource:0}: Error finding container 05e4d01548669790ea30394cac50c76ef301524f09270e52372139b526a38913: Status 404 returned error can't find the container with id 05e4d01548669790ea30394cac50c76ef301524f09270e52372139b526a38913 Jun 05 13:29:08.538913 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:08.538892 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-567d487c66-7htk2"] Jun 05 13:29:08.541135 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:29:08.541114 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5089e0d_5589_46ad_8cc9_613350e6a6a5.slice/crio-046e4c9cf52a64d5559480b5ead8702256bdbd22f49ade030c0d8c94e665ad7a WatchSource:0}: Error finding container 046e4c9cf52a64d5559480b5ead8702256bdbd22f49ade030c0d8c94e665ad7a: Status 404 returned error can't find the container with id 046e4c9cf52a64d5559480b5ead8702256bdbd22f49ade030c0d8c94e665ad7a Jun 05 13:29:09.388607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:09.388571 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerStarted","Data":"25e93713728e685a882d257d648760a348dbfac49c133a49c2698a061f68f266"} Jun 05 13:29:09.389125 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:09.388628 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerStarted","Data":"046e4c9cf52a64d5559480b5ead8702256bdbd22f49ade030c0d8c94e665ad7a"} Jun 05 13:29:09.389125 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:09.388676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:29:09.389874 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:09.389852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvmzq" event={"ID":"b9472347-824d-43fe-b6a1-b53685f25aa0","Type":"ContainerStarted","Data":"05e4d01548669790ea30394cac50c76ef301524f09270e52372139b526a38913"} Jun 05 13:29:09.410818 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:09.410767 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podStartSLOduration=284.410750826 podStartE2EDuration="4m44.410750826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:29:09.408581436 +0000 UTC m=+288.352875748" watchObservedRunningTime="2026-06-05 13:29:09.410750826 +0000 UTC m=+288.355045137" Jun 05 13:29:10.395488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:10.395451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvmzq" event={"ID":"b9472347-824d-43fe-b6a1-b53685f25aa0","Type":"ContainerStarted","Data":"f43664f0f6c736a20d107ad6b707d37064894dd8be1dd940e26aff1e37c6923a"} Jun 05 13:29:10.395873 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:10.395560 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvmzq" event={"ID":"b9472347-824d-43fe-b6a1-b53685f25aa0","Type":"ContainerStarted","Data":"d3a52ea8a909f62667eeecf1f05ede2e9b6674929661a41e640a8ad3dc16b5fd"} Jun 05 13:29:10.395873 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:10.395681 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qvmzq" Jun 05 13:29:10.414327 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:10.414286 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qvmzq" podStartSLOduration=250.749734693 podStartE2EDuration="4m12.41427015s" totalImagesPullingTime="1.664535457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:24:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:29:10.412589432 +0000 UTC m=+289.356883764" watchObservedRunningTime="2026-06-05 13:29:10.41427015 +0000 UTC m=+289.358564458" Jun 05 13:29:17.418861 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:17.418825 2565 generic.go:356] "Generic (PLEG): container finished" podID="de1a44ff-8385-42ff-9354-4afd1be39b12" containerID="cb0d3921a1622dcb7745f08b8c693ff135b389c74d8ce75ba79ad5d13dc55239" exitCode=0 Jun 05 13:29:17.419264 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:17.418900 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kp4xl" event={"ID":"de1a44ff-8385-42ff-9354-4afd1be39b12","Type":"ContainerDied","Data":"cb0d3921a1622dcb7745f08b8c693ff135b389c74d8ce75ba79ad5d13dc55239"} Jun 05 13:29:17.419339 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:17.419323 2565 scope.go:117] "RemoveContainer" containerID="cb0d3921a1622dcb7745f08b8c693ff135b389c74d8ce75ba79ad5d13dc55239" Jun 05 13:29:18.423624 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:18.423589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-kp4xl" event={"ID":"de1a44ff-8385-42ff-9354-4afd1be39b12","Type":"ContainerStarted","Data":"5e83ccd110e2caf6c4de50a5ade84d857d1f09529d30c49f8e5fe7c33cf90a6d"} Jun 05 13:29:20.117870 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:20.117846 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:29:20.319242 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:20.319211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/3.log" Jun 05 13:29:20.401474 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:20.401404 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qvmzq" Jun 05 13:29:20.917340 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:20.917280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvmzq_b9472347-824d-43fe-b6a1-b53685f25aa0/dns/0.log" Jun 05 13:29:21.117763 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.117710 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvmzq_b9472347-824d-43fe-b6a1-b53685f25aa0/kube-rbac-proxy/0.log" Jun 05 13:29:21.395260 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.395229 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:29:21.396788 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.396770 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:29:21.406530 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.406510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:29:21.408500 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.408483 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 13:29:21.408675 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.408659 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:29:21.717081 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:21.717054 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8gbk_36e7f949-4ced-4d2c-ba2e-7e9d319488ac/dns-node-resolver/0.log" Jun 05 13:29:22.317803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:22.317775 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-567d487c66-7htk2_d5089e0d-5589-46ad-8cc9-613350e6a6a5/registry/0.log" Jun 05 13:29:23.117945 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:23.117917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wm82f_00848e40-2fdf-4321-a336-e8363b12c652/node-ca/0.log" Jun 05 13:29:24.117964 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:24.117940 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p89jk_66c3cf0f-dab9-458a-b4e6-4617d28196e6/serve-healthcheck-canary/0.log" Jun 05 13:29:28.389208 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:28.389174 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:28.389578 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:28.389232 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:30.399567 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:30.399534 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:30.399959 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:30.399593 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:37.482971 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:37.482939 2565 generic.go:356] "Generic (PLEG): container finished" podID="8b267e1e-1525-40d1-b356-54d7bee91df2" containerID="f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93" exitCode=1 Jun 05 13:29:37.483378 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:37.482986 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerDied","Data":"f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93"} Jun 05 13:29:37.483378 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:37.483025 2565 scope.go:117] "RemoveContainer" containerID="d1c19f79ec8000080a7870389c32c4bf1683ddbd967ca6bbeadf504e2e055a76" Jun 05 13:29:37.483378 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:37.483336 2565 scope.go:117] "RemoveContainer" containerID="f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93" Jun 05 13:29:37.483548 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:29:37.483511 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64bf464564-l88wp_open-cluster-management-agent-addon(8b267e1e-1525-40d1-b356-54d7bee91df2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" Jun 05 13:29:38.091980 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:38.091948 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:29:38.390077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:38.389972 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:38.390077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:38.390029 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:38.487815 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:38.487784 2565 scope.go:117] "RemoveContainer" containerID="f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93" Jun 05 13:29:38.488196 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:29:38.487954 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64bf464564-l88wp_open-cluster-management-agent-addon(8b267e1e-1525-40d1-b356-54d7bee91df2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" Jun 05 13:29:39.932481 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:39.932440 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:29:39.932962 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:39.932813 2565 scope.go:117] "RemoveContainer" containerID="f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93" Jun 05 13:29:39.932962 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:29:39.932946 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64bf464564-l88wp_open-cluster-management-agent-addon(8b267e1e-1525-40d1-b356-54d7bee91df2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" Jun 05 13:29:40.400452 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:40.400419 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:40.400609 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:40.400471 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:48.389890 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:48.389846 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:48.390363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:48.389903 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:48.390363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:48.389940 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:29:48.390515 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:48.390468 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"25e93713728e685a882d257d648760a348dbfac49c133a49c2698a061f68f266"} pod="openshift-image-registry/image-registry-567d487c66-7htk2" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:29:48.393850 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:48.393823 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:48.393939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:48.393873 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:29:53.459264 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:53.459228 2565 scope.go:117] "RemoveContainer" containerID="f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93" Jun 05 13:29:53.540435 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:53.540400 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerStarted","Data":"a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01"} Jun 05 13:29:53.540761 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:53.540740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:29:53.541874 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:53.541844 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 05 13:29:54.544989 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:54.544956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:29:58.394789 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:58.394752 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:29:58.395200 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:29:58.394813 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:08.394497 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:08.394459 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:08.394860 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:08.394519 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:13.408910 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:13.408828 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" containerID="cri-o://25e93713728e685a882d257d648760a348dbfac49c133a49c2698a061f68f266" gracePeriod=30 Jun 05 13:30:13.604440 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:13.604407 2565 generic.go:356] "Generic (PLEG): container finished" podID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerID="25e93713728e685a882d257d648760a348dbfac49c133a49c2698a061f68f266" exitCode=0 Jun 05 13:30:13.604570 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:13.604462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerDied","Data":"25e93713728e685a882d257d648760a348dbfac49c133a49c2698a061f68f266"} Jun 05 13:30:13.604570 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:13.604514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerStarted","Data":"c0728fc0119b7c539395736fda2e674718b47b09716d200366c93b8a761e7adf"} Jun 05 13:30:13.604721 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:13.604702 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:30:28.390061 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:28.390017 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:28.390443 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:28.390080 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:34.612650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:34.612618 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:34.613021 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:34.612665 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:38.390066 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:38.390024 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:38.390433 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:38.390086 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:44.612710 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:44.612668 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:44.613224 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:44.612736 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:48.389857 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:48.389824 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:48.390359 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:48.389878 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:48.390359 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:48.389922 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:30:48.390501 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:48.390480 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"c0728fc0119b7c539395736fda2e674718b47b09716d200366c93b8a761e7adf"} pod="openshift-image-registry/image-registry-567d487c66-7htk2" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:30:48.393747 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:48.393722 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:48.393865 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:48.393759 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:30:58.394249 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:58.394217 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:30:58.394633 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:30:58.394278 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:08.394344 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:08.394309 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:08.394722 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:08.394362 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:13.408893 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:13.408852 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" containerID="cri-o://c0728fc0119b7c539395736fda2e674718b47b09716d200366c93b8a761e7adf" gracePeriod=30 Jun 05 13:31:13.788082 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:13.788027 2565 generic.go:356] "Generic (PLEG): container finished" podID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerID="c0728fc0119b7c539395736fda2e674718b47b09716d200366c93b8a761e7adf" exitCode=0 Jun 05 13:31:13.788247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:13.788095 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerDied","Data":"c0728fc0119b7c539395736fda2e674718b47b09716d200366c93b8a761e7adf"} Jun 05 13:31:13.788247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:13.788135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerStarted","Data":"8bc9550c223032e590de5f2ac83edf08536d568504d2d6ca70febc88ca336fb6"} Jun 05 13:31:13.788247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:13.788160 2565 scope.go:117] "RemoveContainer" containerID="25e93713728e685a882d257d648760a348dbfac49c133a49c2698a061f68f266" Jun 05 13:31:13.788426 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:13.788267 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:31:28.389784 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:28.389747 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:28.390266 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:28.389808 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:34.798032 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:34.797998 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:34.798419 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:34.798063 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:38.389322 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:38.389288 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:38.389761 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:38.389355 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:44.798368 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:44.798288 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:44.798368 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:44.798344 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:48.389223 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:48.389192 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:48.389587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:48.389248 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:48.389587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:48.389281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:31:48.390479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:48.390445 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"8bc9550c223032e590de5f2ac83edf08536d568504d2d6ca70febc88ca336fb6"} pod="openshift-image-registry/image-registry-567d487c66-7htk2" containerMessage="Container registry failed liveness probe, will be restarted" Jun 05 13:31:48.398084 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:48.398058 2565 patch_prober.go:28] interesting pod/image-registry-567d487c66-7htk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 13:31:48.398215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:48.398105 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:31:50.759971 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.759937 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648f59457d-dxn8x"] Jun 05 13:31:50.762964 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.762943 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.766512 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.766485 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 13:31:50.766617 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.766486 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 13:31:50.767748 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.767729 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 13:31:50.767840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.767731 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 13:31:50.767840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.767770 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 13:31:50.767840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.767774 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 13:31:50.768956 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.768931 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lsw9b\"" Jun 05 13:31:50.769104 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.769086 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 13:31:50.775399 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.775379 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 13:31:50.780836 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.780816 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648f59457d-dxn8x"] Jun 05 13:31:50.788380 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.788352 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jgh4s"] Jun 05 13:31:50.791553 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.791534 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.794917 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.794901 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 13:31:50.795153 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.795139 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dm24g\"" Jun 05 13:31:50.795227 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.795142 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 13:31:50.807246 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.807221 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jgh4s"] Jun 05 13:31:50.831503 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831471 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b428c4ce-3562-451a-8de5-77503c908278-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.831503 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnlkl\" (UniqueName: \"kubernetes.io/projected/043c4836-e8cd-4499-bf6e-3c62af52d950-kube-api-access-fnlkl\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.831679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b428c4ce-3562-451a-8de5-77503c908278-crio-socket\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.831679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-console-config\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.831679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrr9d\" (UniqueName: \"kubernetes.io/projected/b428c4ce-3562-451a-8de5-77503c908278-kube-api-access-qrr9d\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.831679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-serving-cert\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.831679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831662 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b428c4ce-3562-451a-8de5-77503c908278-data-volume\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.831679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-service-ca\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.831888 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-oauth-config\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.831888 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-trusted-ca-bundle\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.831888 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b428c4ce-3562-451a-8de5-77503c908278-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.831888 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.831805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-oauth-serving-cert\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.932962 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.932929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b428c4ce-3562-451a-8de5-77503c908278-crio-socket\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.932962 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.932963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-console-config\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.932981 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrr9d\" (UniqueName: \"kubernetes.io/projected/b428c4ce-3562-451a-8de5-77503c908278-kube-api-access-qrr9d\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-serving-cert\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b428c4ce-3562-451a-8de5-77503c908278-data-volume\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933082 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b428c4ce-3562-451a-8de5-77503c908278-crio-socket\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-service-ca\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-oauth-config\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-trusted-ca-bundle\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b428c4ce-3562-451a-8de5-77503c908278-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.933229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-oauth-serving-cert\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933689 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b428c4ce-3562-451a-8de5-77503c908278-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.933689 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnlkl\" (UniqueName: \"kubernetes.io/projected/043c4836-e8cd-4499-bf6e-3c62af52d950-kube-api-access-fnlkl\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.933689 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933521 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b428c4ce-3562-451a-8de5-77503c908278-data-volume\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.933895 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933868 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-service-ca\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.934070 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-console-config\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.934207 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933894 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-oauth-serving-cert\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.934207 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.933918 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b428c4ce-3562-451a-8de5-77503c908278-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.934366 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.934229 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-trusted-ca-bundle\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.935724 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.935700 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-serving-cert\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.935944 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.935928 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-oauth-config\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.936018 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.936002 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b428c4ce-3562-451a-8de5-77503c908278-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:50.949893 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.949870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnlkl\" (UniqueName: \"kubernetes.io/projected/043c4836-e8cd-4499-bf6e-3c62af52d950-kube-api-access-fnlkl\") pod \"console-648f59457d-dxn8x\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:50.950227 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:50.950209 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrr9d\" (UniqueName: \"kubernetes.io/projected/b428c4ce-3562-451a-8de5-77503c908278-kube-api-access-qrr9d\") pod \"insights-runtime-extractor-jgh4s\" (UID: \"b428c4ce-3562-451a-8de5-77503c908278\") " pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:51.072865 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.072780 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:31:51.100393 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.100365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jgh4s" Jun 05 13:31:51.206700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.206615 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648f59457d-dxn8x"] Jun 05 13:31:51.209104 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:31:51.209071 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043c4836_e8cd_4499_bf6e_3c62af52d950.slice/crio-714931ca6c8a27b4d87ea1e8189c884ce18e9c9e83ef34ef11d7135d4ffa6874 WatchSource:0}: Error finding container 714931ca6c8a27b4d87ea1e8189c884ce18e9c9e83ef34ef11d7135d4ffa6874: Status 404 returned error can't find the container with id 714931ca6c8a27b4d87ea1e8189c884ce18e9c9e83ef34ef11d7135d4ffa6874 Jun 05 13:31:51.211270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.211249 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:31:51.237589 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.237567 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jgh4s"] Jun 05 13:31:51.239902 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:31:51.239878 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb428c4ce_3562_451a_8de5_77503c908278.slice/crio-e95ace00290de7be1839787df2a8d32b4fe0536c56cd5a8b0c86341bd9a34767 WatchSource:0}: Error finding container e95ace00290de7be1839787df2a8d32b4fe0536c56cd5a8b0c86341bd9a34767: Status 404 returned error can't find the container with id e95ace00290de7be1839787df2a8d32b4fe0536c56cd5a8b0c86341bd9a34767 Jun 05 13:31:51.914851 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.914816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648f59457d-dxn8x" event={"ID":"043c4836-e8cd-4499-bf6e-3c62af52d950","Type":"ContainerStarted","Data":"714931ca6c8a27b4d87ea1e8189c884ce18e9c9e83ef34ef11d7135d4ffa6874"} Jun 05 13:31:51.916540 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.916516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgh4s" event={"ID":"b428c4ce-3562-451a-8de5-77503c908278","Type":"ContainerStarted","Data":"b69a4ee7645f718b80ba7fad286aafe4076dd33a7b936713116c9ce628b8d59c"} Jun 05 13:31:51.916642 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:51.916571 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgh4s" event={"ID":"b428c4ce-3562-451a-8de5-77503c908278","Type":"ContainerStarted","Data":"e95ace00290de7be1839787df2a8d32b4fe0536c56cd5a8b0c86341bd9a34767"} Jun 05 13:31:52.922887 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:52.922844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgh4s" event={"ID":"b428c4ce-3562-451a-8de5-77503c908278","Type":"ContainerStarted","Data":"6799a00c923658503bc8a58123b41e1e516f4be8d86adfe18beb1c3de1a80c68"} Jun 05 13:31:53.888361 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.888287 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-62sd4"] Jun 05 13:31:53.892714 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.892691 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:53.896560 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.896538 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 13:31:53.896674 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.896593 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5wdqq\"" Jun 05 13:31:53.896715 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.896539 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 13:31:53.896825 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.896810 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 13:31:53.901412 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.901388 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-62sd4"] Jun 05 13:31:53.956636 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.956599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da4ff8c5-eea6-45ff-b10c-09470c491baa-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:53.957113 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.956651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da4ff8c5-eea6-45ff-b10c-09470c491baa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:53.957113 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.956765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfwgq\" (UniqueName: \"kubernetes.io/projected/da4ff8c5-eea6-45ff-b10c-09470c491baa-kube-api-access-vfwgq\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:53.957113 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:53.956801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4ff8c5-eea6-45ff-b10c-09470c491baa-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.057508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.057471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da4ff8c5-eea6-45ff-b10c-09470c491baa-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.057508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.057520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da4ff8c5-eea6-45ff-b10c-09470c491baa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.057745 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.057573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfwgq\" (UniqueName: \"kubernetes.io/projected/da4ff8c5-eea6-45ff-b10c-09470c491baa-kube-api-access-vfwgq\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.057745 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.057595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4ff8c5-eea6-45ff-b10c-09470c491baa-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.058339 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.058310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da4ff8c5-eea6-45ff-b10c-09470c491baa-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.060363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.060339 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4ff8c5-eea6-45ff-b10c-09470c491baa-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.060363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.060348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da4ff8c5-eea6-45ff-b10c-09470c491baa-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.066891 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.066845 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfwgq\" (UniqueName: \"kubernetes.io/projected/da4ff8c5-eea6-45ff-b10c-09470c491baa-kube-api-access-vfwgq\") pod \"prometheus-operator-7f7d445d84-62sd4\" (UID: \"da4ff8c5-eea6-45ff-b10c-09470c491baa\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.205184 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.205147 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" Jun 05 13:31:54.502164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.502011 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-62sd4"] Jun 05 13:31:54.504634 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:31:54.504608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4ff8c5_eea6_45ff_b10c_09470c491baa.slice/crio-9131182facc53953f933956bbbc71458a3bbcd382b7c935ded66191ec9d30b53 WatchSource:0}: Error finding container 9131182facc53953f933956bbbc71458a3bbcd382b7c935ded66191ec9d30b53: Status 404 returned error can't find the container with id 9131182facc53953f933956bbbc71458a3bbcd382b7c935ded66191ec9d30b53 Jun 05 13:31:54.544824 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.544785 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jun 05 13:31:54.931383 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.931304 2565 generic.go:356] "Generic (PLEG): container finished" podID="8b267e1e-1525-40d1-b356-54d7bee91df2" containerID="a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01" exitCode=1 Jun 05 13:31:54.931524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.931375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerDied","Data":"a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01"} Jun 05 13:31:54.931524 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.931427 2565 scope.go:117] "RemoveContainer" containerID="f1ea5df393e1a8d41071d8daf1096e1e831a7aafcf9de62ecda5e495c2cc1f93" Jun 05 13:31:54.931712 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.931694 2565 scope.go:117] "RemoveContainer" containerID="a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01" Jun 05 13:31:54.931893 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:31:54.931874 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 20s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64bf464564-l88wp_open-cluster-management-agent-addon(8b267e1e-1525-40d1-b356-54d7bee91df2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" Jun 05 13:31:54.932984 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.932962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648f59457d-dxn8x" event={"ID":"043c4836-e8cd-4499-bf6e-3c62af52d950","Type":"ContainerStarted","Data":"b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7"} Jun 05 13:31:54.934814 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.934781 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jgh4s" event={"ID":"b428c4ce-3562-451a-8de5-77503c908278","Type":"ContainerStarted","Data":"93c223a3cd8315650a4f2edca6ca616a71c99646e3cab2fc195679f4ed885b31"} Jun 05 13:31:54.935856 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.935837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" event={"ID":"da4ff8c5-eea6-45ff-b10c-09470c491baa","Type":"ContainerStarted","Data":"9131182facc53953f933956bbbc71458a3bbcd382b7c935ded66191ec9d30b53"} Jun 05 13:31:54.971599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.971542 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jgh4s" podStartSLOduration=1.9538764830000002 podStartE2EDuration="4.971522995s" totalImagesPullingTime="3.017646512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 13:31:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:31:54.970371414 +0000 UTC m=+453.914665722" watchObservedRunningTime="2026-06-05 13:31:54.971522995 +0000 UTC m=+453.915817305" Jun 05 13:31:54.987871 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:54.987832 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648f59457d-dxn8x" podStartSLOduration=1.7726334540000002 podStartE2EDuration="4.987817432s" totalImagesPullingTime="3.215183978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:31:54.987777014 +0000 UTC m=+453.932071357" watchObservedRunningTime="2026-06-05 13:31:54.987817432 +0000 UTC m=+453.932111755" Jun 05 13:31:55.943646 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:55.943602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" event={"ID":"da4ff8c5-eea6-45ff-b10c-09470c491baa","Type":"ContainerStarted","Data":"5ee19524aaaf996f17e9fc59849a9251304e79b82ac65e2cc60143d5b80be78b"} Jun 05 13:31:55.943854 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:55.943714 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" event={"ID":"da4ff8c5-eea6-45ff-b10c-09470c491baa","Type":"ContainerStarted","Data":"376dd6f57ef23097dfe0b4fce170cec20cce900874e0242aee10748e0e8a0521"} Jun 05 13:31:55.966075 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:55.966010 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-62sd4" podStartSLOduration=1.739524797 podStartE2EDuration="2.965995558s" totalImagesPullingTime="1.226470761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:31:55.965025998 +0000 UTC m=+454.909320305" watchObservedRunningTime="2026-06-05 13:31:55.965995558 +0000 UTC m=+454.910289866" Jun 05 13:31:58.266864 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.266826 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9pcpq"] Jun 05 13:31:58.269435 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.269415 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.272150 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.272125 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 13:31:58.272150 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.272138 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 13:31:58.272364 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.272125 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 13:31:58.272475 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.272461 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-87gv9\"" Jun 05 13:31:58.292164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-root\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292263 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292263 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-sys\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292263 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292272 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-textfile\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e54643-4368-4aed-bb07-d0872f47162d-metrics-client-ca\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-wtmp\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-tls\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.292365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.292359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngmb2\" (UniqueName: \"kubernetes.io/projected/38e54643-4368-4aed-bb07-d0872f47162d-kube-api-access-ngmb2\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393505 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-sys\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-sys\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-textfile\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e54643-4368-4aed-bb07-d0872f47162d-metrics-client-ca\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-wtmp\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393970 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393745 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-tls\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393970 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngmb2\" (UniqueName: \"kubernetes.io/projected/38e54643-4368-4aed-bb07-d0872f47162d-kube-api-access-ngmb2\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393970 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-root\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.393970 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.393850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.394312 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.394284 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-wtmp\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.394979 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:31:58.394661 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 13:31:58.394979 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:31:58.394739 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-tls podName:38e54643-4368-4aed-bb07-d0872f47162d nodeName:}" failed. No retries permitted until 2026-06-05 13:31:58.894719428 +0000 UTC m=+457.839013747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-tls") pod "node-exporter-9pcpq" (UID: "38e54643-4368-4aed-bb07-d0872f47162d") : secret "node-exporter-tls" not found Jun 05 13:31:58.394979 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.394846 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/38e54643-4368-4aed-bb07-d0872f47162d-root\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.394979 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.394884 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.395355 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.395321 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e54643-4368-4aed-bb07-d0872f47162d-metrics-client-ca\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.395525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.395505 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-textfile\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.396346 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.396293 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:31:58.396807 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.396787 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.406125 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.406098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngmb2\" (UniqueName: \"kubernetes.io/projected/38e54643-4368-4aed-bb07-d0872f47162d-kube-api-access-ngmb2\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.898764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.898732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-tls\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:58.901003 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:58.900980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/38e54643-4368-4aed-bb07-d0872f47162d-node-exporter-tls\") pod \"node-exporter-9pcpq\" (UID: \"38e54643-4368-4aed-bb07-d0872f47162d\") " pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:59.182615 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.182531 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9pcpq" Jun 05 13:31:59.195648 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:31:59.195614 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e54643_4368_4aed_bb07_d0872f47162d.slice/crio-3cbba9b15f41c21f9ed5e6045b635137fc17467eb3d0d3c0752047799342f7ba WatchSource:0}: Error finding container 3cbba9b15f41c21f9ed5e6045b635137fc17467eb3d0d3c0752047799342f7ba: Status 404 returned error can't find the container with id 3cbba9b15f41c21f9ed5e6045b635137fc17467eb3d0d3c0752047799342f7ba Jun 05 13:31:59.308634 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.308600 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:31:59.312287 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.312265 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.314767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.314744 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 13:31:59.315176 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315154 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 13:31:59.315321 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 13:31:59.315429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315341 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7nsnw\"" Jun 05 13:31:59.315429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 13:31:59.315429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315190 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 13:31:59.315429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315247 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 13:31:59.315429 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315345 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 13:31:59.315701 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315216 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 13:31:59.315896 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.315883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 13:31:59.331290 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.331247 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:31:59.402241 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-config-out\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402241 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-web-config\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tnrr\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-kube-api-access-7tnrr\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.402625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.402607 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.503909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.503878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-config-out\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.503909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.503908 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-web-config\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.503945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504231 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504381 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tnrr\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-kube-api-access-7tnrr\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.504825 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.504557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.505481 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:31:59.505460 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle podName:ec38da22-88cd-495f-9330-6f05a8354956 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:00.005435479 +0000 UTC m=+458.949729777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ec38da22-88cd-495f-9330-6f05a8354956") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:31:59.506152 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.506126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.507421 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.507152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.508315 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.507565 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-web-config\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.508315 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.507680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.508315 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.507915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-config-out\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.508315 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.507964 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.508645 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.508615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.508857 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.508841 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.509001 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.508980 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.509069 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.509014 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.513944 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.513925 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tnrr\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-kube-api-access-7tnrr\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:31:59.932564 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.932469 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:31:59.932967 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.932948 2565 scope.go:117] "RemoveContainer" containerID="a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01" Jun 05 13:31:59.933220 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:31:59.933194 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 20s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64bf464564-l88wp_open-cluster-management-agent-addon(8b267e1e-1525-40d1-b356-54d7bee91df2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" Jun 05 13:31:59.963612 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:31:59.963575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pcpq" event={"ID":"38e54643-4368-4aed-bb07-d0872f47162d","Type":"ContainerStarted","Data":"3cbba9b15f41c21f9ed5e6045b635137fc17467eb3d0d3c0752047799342f7ba"} Jun 05 13:32:00.008776 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:00.008746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:00.008925 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:00.008907 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle podName:ec38da22-88cd-495f-9330-6f05a8354956 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:01.008889612 +0000 UTC m=+459.953183899 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ec38da22-88cd-495f-9330-6f05a8354956") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:00.968144 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:00.968108 2565 generic.go:356] "Generic (PLEG): container finished" podID="38e54643-4368-4aed-bb07-d0872f47162d" containerID="6afa76edf54458bd7be17563aea7d1bcf70894651c7f66a113d471a62897d716" exitCode=0 Jun 05 13:32:00.968569 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:00.968185 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pcpq" event={"ID":"38e54643-4368-4aed-bb07-d0872f47162d","Type":"ContainerDied","Data":"6afa76edf54458bd7be17563aea7d1bcf70894651c7f66a113d471a62897d716"} Jun 05 13:32:01.016987 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.016966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:01.017192 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:01.017161 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle podName:ec38da22-88cd-495f-9330-6f05a8354956 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:03.017140057 +0000 UTC m=+461.961434358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ec38da22-88cd-495f-9330-6f05a8354956") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:01.073814 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.073787 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:32:01.073945 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.073859 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:32:01.079021 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.079001 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:32:01.974026 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.973985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pcpq" event={"ID":"38e54643-4368-4aed-bb07-d0872f47162d","Type":"ContainerStarted","Data":"83d50ada9d2390fe0674d036a3d73ecf573c5ebd22b2e722d024b6742870f709"} Jun 05 13:32:01.974430 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.974076 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9pcpq" event={"ID":"38e54643-4368-4aed-bb07-d0872f47162d","Type":"ContainerStarted","Data":"a3c7ba31d3a3d8b5e4bb4077c48fa48b0eca0765fb0386de5d9594d3f01175d5"} Jun 05 13:32:01.977727 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.977707 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:32:01.997391 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:01.997352 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9pcpq" podStartSLOduration=3.075813451 podStartE2EDuration="3.997336628s" totalImagesPullingTime="856.571865ms" totalInitContainerRuntime="64.951312ms" isStatefulPod=true podCreationTimestamp="2026-06-05 13:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:01.995197816 +0000 UTC m=+460.939492136" watchObservedRunningTime="2026-06-05 13:32:01.997336628 +0000 UTC m=+460.941630976" Jun 05 13:32:03.036194 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.036159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:03.036661 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:03.036331 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle podName:ec38da22-88cd-495f-9330-6f05a8354956 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:07.036308025 +0000 UTC m=+465.980602324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ec38da22-88cd-495f-9330-6f05a8354956") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:03.037833 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.037808 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk"] Jun 05 13:32:03.040835 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.040820 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.043387 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.043368 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 13:32:03.043614 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.043600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wtb27\"" Jun 05 13:32:03.049289 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.049256 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk"] Jun 05 13:32:03.137551 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.137517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6872bf60-dcf1-41b7-9c39-1632eab7ada3-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.137755 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.137592 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fx6\" (UniqueName: \"kubernetes.io/projected/6872bf60-dcf1-41b7-9c39-1632eab7ada3-kube-api-access-89fx6\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.238950 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.238912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fx6\" (UniqueName: \"kubernetes.io/projected/6872bf60-dcf1-41b7-9c39-1632eab7ada3-kube-api-access-89fx6\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.239177 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.239006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6872bf60-dcf1-41b7-9c39-1632eab7ada3-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.239177 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:03.239131 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 13:32:03.239305 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:03.239199 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6872bf60-dcf1-41b7-9c39-1632eab7ada3-monitoring-plugin-cert podName:6872bf60-dcf1-41b7-9c39-1632eab7ada3 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:03.739177687 +0000 UTC m=+462.683471974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6872bf60-dcf1-41b7-9c39-1632eab7ada3-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-6dxpk" (UID: "6872bf60-dcf1-41b7-9c39-1632eab7ada3") : secret "monitoring-plugin-cert" not found Jun 05 13:32:03.249708 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.249680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fx6\" (UniqueName: \"kubernetes.io/projected/6872bf60-dcf1-41b7-9c39-1632eab7ada3-kube-api-access-89fx6\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.463785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.463760 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-ddcddc999-bcwvx"] Jun 05 13:32:03.467274 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.467255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.469957 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.469923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 13:32:03.470100 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.469958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 13:32:03.470100 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.470011 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 13:32:03.470100 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.470073 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qqxq7\"" Jun 05 13:32:03.470298 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.470283 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 13:32:03.470339 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.470321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 13:32:03.478331 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.478312 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 13:32:03.484875 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.484855 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ddcddc999-bcwvx"] Jun 05 13:32:03.542252 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-telemeter-client-tls\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542424 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542424 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twnpq\" (UniqueName: \"kubernetes.io/projected/a299ebac-4316-40f8-8ce1-1f16d4c250a9-kube-api-access-twnpq\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542424 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-metrics-client-ca\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542424 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-serving-certs-ca-bundle\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542424 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-secret-telemeter-client\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.542607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.542474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-federate-client-tls\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643557 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-telemeter-client-tls\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643557 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643819 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twnpq\" (UniqueName: \"kubernetes.io/projected/a299ebac-4316-40f8-8ce1-1f16d4c250a9-kube-api-access-twnpq\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643819 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-metrics-client-ca\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643819 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-serving-certs-ca-bundle\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643961 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.643961 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-secret-telemeter-client\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.644077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.643988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-federate-client-tls\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.644575 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.644542 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-metrics-client-ca\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.644575 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.644572 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-serving-certs-ca-bundle\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.644840 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.644820 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a299ebac-4316-40f8-8ce1-1f16d4c250a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.646526 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.646499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.646526 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.646515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-federate-client-tls\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.646636 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.646504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-secret-telemeter-client\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.646636 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.646601 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a299ebac-4316-40f8-8ce1-1f16d4c250a9-telemeter-client-tls\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.651731 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.651708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twnpq\" (UniqueName: \"kubernetes.io/projected/a299ebac-4316-40f8-8ce1-1f16d4c250a9-kube-api-access-twnpq\") pod \"telemeter-client-ddcddc999-bcwvx\" (UID: \"a299ebac-4316-40f8-8ce1-1f16d4c250a9\") " pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.745263 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.745177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6872bf60-dcf1-41b7-9c39-1632eab7ada3-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.747498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.747480 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6872bf60-dcf1-41b7-9c39-1632eab7ada3-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-6dxpk\" (UID: \"6872bf60-dcf1-41b7-9c39-1632eab7ada3\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.783385 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.783358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" Jun 05 13:32:03.914598 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.914574 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ddcddc999-bcwvx"] Jun 05 13:32:03.916805 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:32:03.916776 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda299ebac_4316_40f8_8ce1_1f16d4c250a9.slice/crio-e3259ac7d3bf2a1c08cc94fc708fa14c94b290ec0ed652ef08ba2515559eba4b WatchSource:0}: Error finding container e3259ac7d3bf2a1c08cc94fc708fa14c94b290ec0ed652ef08ba2515559eba4b: Status 404 returned error can't find the container with id e3259ac7d3bf2a1c08cc94fc708fa14c94b290ec0ed652ef08ba2515559eba4b Jun 05 13:32:03.950428 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.950403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:03.982265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:03.982231 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" event={"ID":"a299ebac-4316-40f8-8ce1-1f16d4c250a9","Type":"ContainerStarted","Data":"e3259ac7d3bf2a1c08cc94fc708fa14c94b290ec0ed652ef08ba2515559eba4b"} Jun 05 13:32:04.075563 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.075541 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk"] Jun 05 13:32:04.077836 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:32:04.077806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6872bf60_dcf1_41b7_9c39_1632eab7ada3.slice/crio-b5f21c2c7b37df9be8c7385344c8360253099f9a63c54edbccdb55a52b0e3141 WatchSource:0}: Error finding container b5f21c2c7b37df9be8c7385344c8360253099f9a63c54edbccdb55a52b0e3141: Status 404 returned error can't find the container with id b5f21c2c7b37df9be8c7385344c8360253099f9a63c54edbccdb55a52b0e3141 Jun 05 13:32:04.468087 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.468053 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:32:04.472503 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.472457 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.475123 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475095 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 13:32:04.475307 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 13:32:04.475474 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475409 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 13:32:04.475474 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475453 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 13:32:04.475612 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475598 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 13:32:04.476232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475719 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 13:32:04.476232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475784 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d13n1vkuaseba\"" Jun 05 13:32:04.476232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475783 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 13:32:04.476232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.475985 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 13:32:04.476232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.476029 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gn2h9\"" Jun 05 13:32:04.476232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.476202 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 13:32:04.476872 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.476720 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 13:32:04.476996 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.476959 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 13:32:04.477100 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.476966 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 13:32:04.477100 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.477010 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 13:32:04.477291 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.477262 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 13:32:04.480342 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.479314 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 13:32:04.494949 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.493414 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:32:04.544572 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.544508 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:32:04.545125 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.545097 2565 scope.go:117] "RemoveContainer" containerID="a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01" Jun 05 13:32:04.545407 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:04.545361 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 20s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-64bf464564-l88wp_open-cluster-management-agent-addon(8b267e1e-1525-40d1-b356-54d7bee91df2)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" podUID="8b267e1e-1525-40d1-b356-54d7bee91df2" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554319 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-config-out\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554542 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-config\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-web-config\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.555587 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.554972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v8js\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-kube-api-access-8v8js\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.556561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.555007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.556561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.555104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.556561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.555149 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.556561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.555175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656545 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656545 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v8js\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-kube-api-access-8v8js\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.656785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656832 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-config-out\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.656967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-config\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657138 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657077 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-web-config\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657561 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.657717 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657608 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.658342 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.657911 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.658342 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.658119 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.658342 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.658230 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.658994 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.658827 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.661972 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:04.661003 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle podName:1eabf43a-6232-4a1a-9022-d984fb80f835 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:05.160983728 +0000 UTC m=+464.105278019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:04.665822 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.664354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.665822 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.665422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.665822 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.665436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.667991 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.667834 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.668546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.668507 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.669866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.669719 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-web-config\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.669866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.669792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v8js\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-kube-api-access-8v8js\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.673329 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.672836 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.673329 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.673239 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-config-out\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.673329 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.673291 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.673645 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.673622 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.673901 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.673865 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-config\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.674540 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.674520 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.675827 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.675802 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:04.991228 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:04.991173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" event={"ID":"6872bf60-dcf1-41b7-9c39-1632eab7ada3","Type":"ContainerStarted","Data":"b5f21c2c7b37df9be8c7385344c8360253099f9a63c54edbccdb55a52b0e3141"} Jun 05 13:32:05.164453 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:05.164406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:05.164851 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:05.164595 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle podName:1eabf43a-6232-4a1a-9022-d984fb80f835 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:06.164577892 +0000 UTC m=+465.108872185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:06.001548 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:06.001514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" event={"ID":"a299ebac-4316-40f8-8ce1-1f16d4c250a9","Type":"ContainerStarted","Data":"3e2e95165869ed30cee9376f772bcbfe81b3f2cb97bb4f4cea9e045cf899ac16"} Jun 05 13:32:06.002802 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:06.002777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" event={"ID":"6872bf60-dcf1-41b7-9c39-1632eab7ada3","Type":"ContainerStarted","Data":"927b29f3b9a864050ce375beff30146feb6b50214011625ef8efc9447c6bcde9"} Jun 05 13:32:06.003003 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:06.002986 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:06.007384 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:06.007364 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" Jun 05 13:32:06.018667 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:06.018625 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-6dxpk" podStartSLOduration=1.2586992129999999 podStartE2EDuration="3.018608764s" totalImagesPullingTime="1.759909551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:06.017831911 +0000 UTC m=+464.962126222" watchObservedRunningTime="2026-06-05 13:32:06.018608764 +0000 UTC m=+464.962903075" Jun 05 13:32:06.174554 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:06.174471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:06.174907 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:06.174613 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle podName:1eabf43a-6232-4a1a-9022-d984fb80f835 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:08.174598511 +0000 UTC m=+467.118892798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:07.008849 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:07.008815 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" event={"ID":"a299ebac-4316-40f8-8ce1-1f16d4c250a9","Type":"ContainerStarted","Data":"152fb49778ba106cb8f0770b6a1b128637fc4c3fd3af1e79939c8ce32c7ef618"} Jun 05 13:32:07.009127 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:07.008871 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" event={"ID":"a299ebac-4316-40f8-8ce1-1f16d4c250a9","Type":"ContainerStarted","Data":"880e4a23888fe63363505ff1de51e72b0d33e050dca686be83f2c9cd6c161f09"} Jun 05 13:32:07.032878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:07.032817 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-ddcddc999-bcwvx" podStartSLOduration=1.208555356 podStartE2EDuration="4.032795242s" totalImagesPullingTime="2.824239886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:32:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:07.030320352 +0000 UTC m=+465.974614683" watchObservedRunningTime="2026-06-05 13:32:07.032795242 +0000 UTC m=+465.977089552" Jun 05 13:32:07.084141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:07.084055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:07.084297 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:07.084177 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle podName:ec38da22-88cd-495f-9330-6f05a8354956 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:15.084158872 +0000 UTC m=+474.028453158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ec38da22-88cd-495f-9330-6f05a8354956") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:08.196560 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:08.196525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:08.196907 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:08.196723 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle podName:1eabf43a-6232-4a1a-9022-d984fb80f835 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:12.196700739 +0000 UTC m=+471.140995038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:12.233517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:12.233478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:12.233929 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:12.233623 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle podName:1eabf43a-6232-4a1a-9022-d984fb80f835 nodeName:}" failed. No retries permitted until 2026-06-05 13:32:20.233605697 +0000 UTC m=+479.177899985 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "prometheus-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle") pod "prometheus-k8s-0" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835") : configmap references non-existent config key: ca-bundle.crt Jun 05 13:32:13.129879 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:13.129837 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-567d487c66-7htk2"] Jun 05 13:32:13.410305 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:13.410208 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" containerID="cri-o://8bc9550c223032e590de5f2ac83edf08536d568504d2d6ca70febc88ca336fb6" gracePeriod=30 Jun 05 13:32:14.038609 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:14.038573 2565 generic.go:356] "Generic (PLEG): container finished" podID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerID="8bc9550c223032e590de5f2ac83edf08536d568504d2d6ca70febc88ca336fb6" exitCode=0 Jun 05 13:32:14.038788 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:14.038643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerDied","Data":"8bc9550c223032e590de5f2ac83edf08536d568504d2d6ca70febc88ca336fb6"} Jun 05 13:32:14.038788 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:14.038685 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerStarted","Data":"83ef650c21038422bcf91e16555a0f5ccb9c861815c6cbdc20679337c836ca01"} Jun 05 13:32:14.038788 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:14.038711 2565 scope.go:117] "RemoveContainer" containerID="c0728fc0119b7c539395736fda2e674718b47b09716d200366c93b8a761e7adf" Jun 05 13:32:14.038943 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:14.038848 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:32:15.162796 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:15.162752 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:15.163521 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:15.163500 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:15.223902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:15.223860 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:32:15.361900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:15.361871 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:32:15.362140 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:32:15.362118 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec38da22_88cd_495f_9330_6f05a8354956.slice/crio-c863b6ce8293c997d3b5e4ba3405c44e8c62e7a4941d9f065d6815cf932eb1ae WatchSource:0}: Error finding container c863b6ce8293c997d3b5e4ba3405c44e8c62e7a4941d9f065d6815cf932eb1ae: Status 404 returned error can't find the container with id c863b6ce8293c997d3b5e4ba3405c44e8c62e7a4941d9f065d6815cf932eb1ae Jun 05 13:32:15.472571 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:15.462468 2565 scope.go:117] "RemoveContainer" containerID="a135182f609493770dd6bbb60656cd149dfc29c98cf1881ffaba3b26cb0f2d01" Jun 05 13:32:16.049717 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:16.049682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" event={"ID":"8b267e1e-1525-40d1-b356-54d7bee91df2","Type":"ContainerStarted","Data":"d5f8d9ace0978cb6d6f41989d91d034ee865543afeaad339422176e7006b0091"} Jun 05 13:32:16.050028 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:16.049998 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:32:16.051213 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:16.051184 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5" exitCode=0 Jun 05 13:32:16.051360 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:16.051237 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5"} Jun 05 13:32:16.051360 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:16.051294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"c863b6ce8293c997d3b5e4ba3405c44e8c62e7a4941d9f065d6815cf932eb1ae"} Jun 05 13:32:16.051670 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:16.051653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64bf464564-l88wp" Jun 05 13:32:18.067343 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:18.067266 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff"} Jun 05 13:32:18.067700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:18.067352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5"} Jun 05 13:32:18.067700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:18.067380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4"} Jun 05 13:32:18.067700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:18.067404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0"} Jun 05 13:32:18.067700 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:18.067431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72"} Jun 05 13:32:18.242520 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:18.242486 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648f59457d-dxn8x"] Jun 05 13:32:19.074637 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:19.074600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerStarted","Data":"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c"} Jun 05 13:32:19.107328 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:19.107260 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=17.911929411 podStartE2EDuration="20.107242025s" totalImagesPullingTime="2.176698676s" totalInitContainerRuntime="18.613938ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:31:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:19.105293568 +0000 UTC m=+478.049587876" watchObservedRunningTime="2026-06-05 13:32:19.107242025 +0000 UTC m=+478.051536374" Jun 05 13:32:20.314215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:20.314178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:20.315135 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:20.315115 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:20.386109 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:20.386075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:20.525521 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:20.525500 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:32:20.527533 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:32:20.527502 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eabf43a_6232_4a1a_9022_d984fb80f835.slice/crio-8ca7799f8c79dd0b412f0a40e3bb5d135ffa4e584e0cc6a2611095cabd3e894a WatchSource:0}: Error finding container 8ca7799f8c79dd0b412f0a40e3bb5d135ffa4e584e0cc6a2611095cabd3e894a: Status 404 returned error can't find the container with id 8ca7799f8c79dd0b412f0a40e3bb5d135ffa4e584e0cc6a2611095cabd3e894a Jun 05 13:32:21.083393 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:21.083356 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" exitCode=0 Jun 05 13:32:21.083538 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:21.083440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} Jun 05 13:32:21.083538 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:21.083510 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"8ca7799f8c79dd0b412f0a40e3bb5d135ffa4e584e0cc6a2611095cabd3e894a"} Jun 05 13:32:24.105028 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:24.104991 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} Jun 05 13:32:24.105419 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:24.105097 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} Jun 05 13:32:27.125622 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:27.125584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} Jun 05 13:32:27.126098 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:27.125684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} Jun 05 13:32:27.126098 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:27.125734 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} Jun 05 13:32:27.126098 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:27.125777 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerStarted","Data":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} Jun 05 13:32:27.155377 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:27.155323 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=18.241590778 podStartE2EDuration="23.155283481s" totalImagesPullingTime="4.896449118s" totalInitContainerRuntime="17.243585ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:32:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:32:27.15274943 +0000 UTC m=+486.097043740" watchObservedRunningTime="2026-06-05 13:32:27.155283481 +0000 UTC m=+486.099577793" Jun 05 13:32:30.387123 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:30.387091 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:32:34.043838 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:34.043808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:32:39.057484 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.057448 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-567d487c66-7htk2" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" containerID="cri-o://83ef650c21038422bcf91e16555a0f5ccb9c861815c6cbdc20679337c836ca01" gracePeriod=30 Jun 05 13:32:39.175321 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.175287 2565 generic.go:356] "Generic (PLEG): container finished" podID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerID="83ef650c21038422bcf91e16555a0f5ccb9c861815c6cbdc20679337c836ca01" exitCode=0 Jun 05 13:32:39.175440 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.175340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerDied","Data":"83ef650c21038422bcf91e16555a0f5ccb9c861815c6cbdc20679337c836ca01"} Jun 05 13:32:39.175440 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.175393 2565 scope.go:117] "RemoveContainer" containerID="8bc9550c223032e590de5f2ac83edf08536d568504d2d6ca70febc88ca336fb6" Jun 05 13:32:39.310871 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.310815 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:32:39.377378 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377349 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5089e0d-5589-46ad-8cc9-613350e6a6a5-ca-trust-extracted\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.377562 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377399 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-installation-pull-secrets\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.377562 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377423 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-certificates\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.377562 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377441 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-trusted-ca\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.377562 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377479 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.377562 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-bound-sa-token\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.377826 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.377776 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.378154 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.378122 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:39.378298 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.378229 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-image-registry-private-configuration\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.378368 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.378330 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tb9fq\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-kube-api-access-tb9fq\") pod \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\" (UID: \"d5089e0d-5589-46ad-8cc9-613350e6a6a5\") " Jun 05 13:32:39.378835 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.378809 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-certificates\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.378968 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.378839 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5089e0d-5589-46ad-8cc9-613350e6a6a5-trusted-ca\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.380118 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.380074 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.380367 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.380343 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.380367 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.380352 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:39.380610 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.380591 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:39.380734 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.380705 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-kube-api-access-tb9fq" (OuterVolumeSpecName: "kube-api-access-tb9fq") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "kube-api-access-tb9fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:39.386397 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.386377 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5089e0d-5589-46ad-8cc9-613350e6a6a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5089e0d-5589-46ad-8cc9-613350e6a6a5" (UID: "d5089e0d-5589-46ad-8cc9-613350e6a6a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:32:39.479609 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.479586 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tb9fq\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-kube-api-access-tb9fq\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.479694 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.479624 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5089e0d-5589-46ad-8cc9-613350e6a6a5-ca-trust-extracted\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.479694 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.479634 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-installation-pull-secrets\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.479694 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.479660 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-registry-tls\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.479694 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.479668 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5089e0d-5589-46ad-8cc9-613350e6a6a5-bound-sa-token\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:39.479694 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:39.479678 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5089e0d-5589-46ad-8cc9-613350e6a6a5-image-registry-private-configuration\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:40.180362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:40.180325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-567d487c66-7htk2" event={"ID":"d5089e0d-5589-46ad-8cc9-613350e6a6a5","Type":"ContainerDied","Data":"046e4c9cf52a64d5559480b5ead8702256bdbd22f49ade030c0d8c94e665ad7a"} Jun 05 13:32:40.180362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:40.180346 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-567d487c66-7htk2" Jun 05 13:32:40.180865 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:40.180387 2565 scope.go:117] "RemoveContainer" containerID="83ef650c21038422bcf91e16555a0f5ccb9c861815c6cbdc20679337c836ca01" Jun 05 13:32:40.199563 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:40.199540 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-567d487c66-7htk2"] Jun 05 13:32:40.203119 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:40.203095 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-567d487c66-7htk2"] Jun 05 13:32:41.463579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:41.463549 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" path="/var/lib/kubelet/pods/d5089e0d-5589-46ad-8cc9-613350e6a6a5/volumes" Jun 05 13:32:43.263807 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.263761 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-648f59457d-dxn8x" podUID="043c4836-e8cd-4499-bf6e-3c62af52d950" containerName="console" containerID="cri-o://b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7" gracePeriod=15 Jun 05 13:32:43.509905 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.509875 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:32:43.618786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618700 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-trusted-ca-bundle\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.618786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618750 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-oauth-config\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.618786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618787 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnlkl\" (UniqueName: \"kubernetes.io/projected/043c4836-e8cd-4499-bf6e-3c62af52d950-kube-api-access-fnlkl\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.619095 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618842 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-oauth-serving-cert\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.619095 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618885 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-serving-cert\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.619095 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618922 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-service-ca\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.619095 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.618967 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-console-config\") pod \"043c4836-e8cd-4499-bf6e-3c62af52d950\" (UID: \"043c4836-e8cd-4499-bf6e-3c62af52d950\") " Jun 05 13:32:43.619299 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.619268 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:43.619343 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.619314 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:43.619517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.619489 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-service-ca" (OuterVolumeSpecName: "service-ca") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:43.619517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.619508 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-console-config" (OuterVolumeSpecName: "console-config") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:32:43.621221 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.621196 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:43.621312 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.621229 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043c4836-e8cd-4499-bf6e-3c62af52d950-kube-api-access-fnlkl" (OuterVolumeSpecName: "kube-api-access-fnlkl") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "kube-api-access-fnlkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:32:43.621354 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.621306 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "043c4836-e8cd-4499-bf6e-3c62af52d950" (UID: "043c4836-e8cd-4499-bf6e-3c62af52d950"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:32:43.719671 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719639 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-oauth-config\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:43.719671 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719667 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnlkl\" (UniqueName: \"kubernetes.io/projected/043c4836-e8cd-4499-bf6e-3c62af52d950-kube-api-access-fnlkl\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:43.719671 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719676 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-oauth-serving-cert\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:43.719896 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719685 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/043c4836-e8cd-4499-bf6e-3c62af52d950-console-serving-cert\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:43.719896 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719695 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-service-ca\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:43.719896 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719703 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-console-config\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:43.719896 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:43.719711 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/043c4836-e8cd-4499-bf6e-3c62af52d950-trusted-ca-bundle\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:32:44.197992 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.197955 2565 generic.go:356] "Generic (PLEG): container finished" podID="043c4836-e8cd-4499-bf6e-3c62af52d950" containerID="b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7" exitCode=0 Jun 05 13:32:44.198193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.198003 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648f59457d-dxn8x" Jun 05 13:32:44.198193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.198001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648f59457d-dxn8x" event={"ID":"043c4836-e8cd-4499-bf6e-3c62af52d950","Type":"ContainerDied","Data":"b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7"} Jun 05 13:32:44.198193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.198131 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648f59457d-dxn8x" event={"ID":"043c4836-e8cd-4499-bf6e-3c62af52d950","Type":"ContainerDied","Data":"714931ca6c8a27b4d87ea1e8189c884ce18e9c9e83ef34ef11d7135d4ffa6874"} Jun 05 13:32:44.198193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.198161 2565 scope.go:117] "RemoveContainer" containerID="b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7" Jun 05 13:32:44.207179 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.207165 2565 scope.go:117] "RemoveContainer" containerID="b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7" Jun 05 13:32:44.207423 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:32:44.207405 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7\": container with ID starting with b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7 not found: ID does not exist" containerID="b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7" Jun 05 13:32:44.207467 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.207431 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7"} err="failed to get container status \"b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7\": rpc error: code = NotFound desc = could not find container \"b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7\": container with ID starting with b78aaecad03679625f327acf71dc27ef1616e7fb7d45d17cc1d94824d3121bd7 not found: ID does not exist" Jun 05 13:32:44.220372 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.220345 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-648f59457d-dxn8x"] Jun 05 13:32:44.225548 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:44.225516 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-648f59457d-dxn8x"] Jun 05 13:32:45.464089 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:32:45.464051 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="043c4836-e8cd-4499-bf6e-3c62af52d950" path="/var/lib/kubelet/pods/043c4836-e8cd-4499-bf6e-3c62af52d950/volumes" Jun 05 13:33:20.386725 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:20.386689 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:20.406754 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:20.406725 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:21.362944 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:21.362920 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:28.652831 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.652800 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:33:28.653410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.653102 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="alertmanager" containerID="cri-o://c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72" gracePeriod=120 Jun 05 13:33:28.653410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.653201 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-web" containerID="cri-o://f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4" gracePeriod=120 Jun 05 13:33:28.653410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.653194 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-metric" containerID="cri-o://ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff" gracePeriod=120 Jun 05 13:33:28.653410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.653212 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="config-reloader" containerID="cri-o://a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0" gracePeriod=120 Jun 05 13:33:28.653410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.653273 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy" containerID="cri-o://f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5" gracePeriod=120 Jun 05 13:33:28.653410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:28.653275 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="prom-label-proxy" containerID="cri-o://0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c" gracePeriod=120 Jun 05 13:33:29.381758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381726 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c" exitCode=0 Jun 05 13:33:29.381758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381750 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5" exitCode=0 Jun 05 13:33:29.381758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381756 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0" exitCode=0 Jun 05 13:33:29.381758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381763 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72" exitCode=0 Jun 05 13:33:29.382027 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c"} Jun 05 13:33:29.382027 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381857 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5"} Jun 05 13:33:29.382027 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0"} Jun 05 13:33:29.382027 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.381909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72"} Jun 05 13:33:29.910382 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:29.910360 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.003483 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003403 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-config-out\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003483 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003444 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-cluster-tls-config\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003483 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003466 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tnrr\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-kube-api-access-7tnrr\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003505 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-web\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003531 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003558 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-main-tls\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003581 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-tls-assets\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003621 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-config-volume\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003649 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-main-db\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003673 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-web-config\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003702 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.003762 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003742 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.004232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.003768 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-metrics-client-ca\") pod \"ec38da22-88cd-495f-9330-6f05a8354956\" (UID: \"ec38da22-88cd-495f-9330-6f05a8354956\") " Jun 05 13:33:30.004232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.004059 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:33:30.004371 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.004344 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:30.006468 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.006332 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.006710 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.006607 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.006710 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.006624 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.006710 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.006644 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-kube-api-access-7tnrr" (OuterVolumeSpecName: "kube-api-access-7tnrr") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "kube-api-access-7tnrr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:33:30.007000 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.006965 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:30.007121 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.007059 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:33:30.007278 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.007249 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-config-out" (OuterVolumeSpecName: "config-out") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:33:30.008414 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.008389 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.008768 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.008743 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-config-volume" (OuterVolumeSpecName: "config-volume") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.010305 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.010279 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.016481 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.016461 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-web-config" (OuterVolumeSpecName: "web-config") pod "ec38da22-88cd-495f-9330-6f05a8354956" (UID: "ec38da22-88cd-495f-9330-6f05a8354956"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:30.105232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105196 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105228 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-main-tls\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105242 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-tls-assets\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105253 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-config-volume\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105264 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-main-db\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105277 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-web-config\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105288 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105299 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105312 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec38da22-88cd-495f-9330-6f05a8354956-metrics-client-ca\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105325 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec38da22-88cd-495f-9330-6f05a8354956-config-out\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105337 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-cluster-tls-config\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105348 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tnrr\" (UniqueName: \"kubernetes.io/projected/ec38da22-88cd-495f-9330-6f05a8354956-kube-api-access-7tnrr\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.105488 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.105359 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec38da22-88cd-495f-9330-6f05a8354956-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:30.388652 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388556 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff" exitCode=0 Jun 05 13:33:30.388652 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388595 2565 generic.go:356] "Generic (PLEG): container finished" podID="ec38da22-88cd-495f-9330-6f05a8354956" containerID="f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4" exitCode=0 Jun 05 13:33:30.388652 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff"} Jun 05 13:33:30.388861 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388656 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.388861 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4"} Jun 05 13:33:30.388861 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec38da22-88cd-495f-9330-6f05a8354956","Type":"ContainerDied","Data":"c863b6ce8293c997d3b5e4ba3405c44e8c62e7a4941d9f065d6815cf932eb1ae"} Jun 05 13:33:30.388861 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.388828 2565 scope.go:117] "RemoveContainer" containerID="0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c" Jun 05 13:33:30.396682 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.396529 2565 scope.go:117] "RemoveContainer" containerID="ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff" Jun 05 13:33:30.403869 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.403851 2565 scope.go:117] "RemoveContainer" containerID="f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5" Jun 05 13:33:30.410256 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.410241 2565 scope.go:117] "RemoveContainer" containerID="f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4" Jun 05 13:33:30.413227 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.413206 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:33:30.417603 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.417567 2565 scope.go:117] "RemoveContainer" containerID="a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0" Jun 05 13:33:30.419590 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.419573 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:33:30.425352 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.425336 2565 scope.go:117] "RemoveContainer" containerID="c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72" Jun 05 13:33:30.431943 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.431911 2565 scope.go:117] "RemoveContainer" containerID="cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5" Jun 05 13:33:30.438728 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.438710 2565 scope.go:117] "RemoveContainer" containerID="0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c" Jun 05 13:33:30.438963 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.438943 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c\": container with ID starting with 0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c not found: ID does not exist" containerID="0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c" Jun 05 13:33:30.439020 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.438972 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c"} err="failed to get container status \"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c\": rpc error: code = NotFound desc = could not find container \"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c\": container with ID starting with 0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c not found: ID does not exist" Jun 05 13:33:30.439020 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.438993 2565 scope.go:117] "RemoveContainer" containerID="ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff" Jun 05 13:33:30.439270 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.439254 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff\": container with ID starting with ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff not found: ID does not exist" containerID="ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff" Jun 05 13:33:30.439324 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439275 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff"} err="failed to get container status \"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff\": rpc error: code = NotFound desc = could not find container \"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff\": container with ID starting with ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff not found: ID does not exist" Jun 05 13:33:30.439324 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439291 2565 scope.go:117] "RemoveContainer" containerID="f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5" Jun 05 13:33:30.439510 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.439482 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5\": container with ID starting with f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5 not found: ID does not exist" containerID="f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5" Jun 05 13:33:30.439557 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439511 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5"} err="failed to get container status \"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5\": rpc error: code = NotFound desc = could not find container \"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5\": container with ID starting with f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5 not found: ID does not exist" Jun 05 13:33:30.439557 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439527 2565 scope.go:117] "RemoveContainer" containerID="f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4" Jun 05 13:33:30.439714 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.439700 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4\": container with ID starting with f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4 not found: ID does not exist" containerID="f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4" Jun 05 13:33:30.439761 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439717 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4"} err="failed to get container status \"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4\": rpc error: code = NotFound desc = could not find container \"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4\": container with ID starting with f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4 not found: ID does not exist" Jun 05 13:33:30.439761 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439729 2565 scope.go:117] "RemoveContainer" containerID="a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0" Jun 05 13:33:30.439909 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.439894 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0\": container with ID starting with a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0 not found: ID does not exist" containerID="a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0" Jun 05 13:33:30.439962 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439909 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0"} err="failed to get container status \"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0\": rpc error: code = NotFound desc = could not find container \"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0\": container with ID starting with a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0 not found: ID does not exist" Jun 05 13:33:30.439962 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.439920 2565 scope.go:117] "RemoveContainer" containerID="c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72" Jun 05 13:33:30.440147 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.440131 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72\": container with ID starting with c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72 not found: ID does not exist" containerID="c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72" Jun 05 13:33:30.440196 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440149 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72"} err="failed to get container status \"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72\": rpc error: code = NotFound desc = could not find container \"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72\": container with ID starting with c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72 not found: ID does not exist" Jun 05 13:33:30.440196 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440161 2565 scope.go:117] "RemoveContainer" containerID="cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5" Jun 05 13:33:30.440377 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:30.440360 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5\": container with ID starting with cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5 not found: ID does not exist" containerID="cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5" Jun 05 13:33:30.440412 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440382 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5"} err="failed to get container status \"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5\": rpc error: code = NotFound desc = could not find container \"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5\": container with ID starting with cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5 not found: ID does not exist" Jun 05 13:33:30.440412 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440394 2565 scope.go:117] "RemoveContainer" containerID="0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c" Jun 05 13:33:30.440607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440591 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c"} err="failed to get container status \"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c\": rpc error: code = NotFound desc = could not find container \"0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c\": container with ID starting with 0658b281fe742a2edf9690c259105acf2260747147fb86a821bcb8d75a0c553c not found: ID does not exist" Jun 05 13:33:30.440607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440606 2565 scope.go:117] "RemoveContainer" containerID="ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff" Jun 05 13:33:30.440812 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440796 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff"} err="failed to get container status \"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff\": rpc error: code = NotFound desc = could not find container \"ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff\": container with ID starting with ed04277371d90b5b112281f297aac1efb3b028fb12bbeb80076b167737e68aff not found: ID does not exist" Jun 05 13:33:30.440853 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.440813 2565 scope.go:117] "RemoveContainer" containerID="f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5" Jun 05 13:33:30.441056 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441025 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5"} err="failed to get container status \"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5\": rpc error: code = NotFound desc = could not find container \"f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5\": container with ID starting with f2b96569c3b93edc438e2a626ee77ce9907ffae880d78c28dc30ebbe349f92e5 not found: ID does not exist" Jun 05 13:33:30.441114 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441059 2565 scope.go:117] "RemoveContainer" containerID="f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4" Jun 05 13:33:30.441336 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441319 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4"} err="failed to get container status \"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4\": rpc error: code = NotFound desc = could not find container \"f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4\": container with ID starting with f1c8ded2863bb2e32c9052844bcde0db4932bd05286229ce3c20a013d428b9e4 not found: ID does not exist" Jun 05 13:33:30.441401 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441338 2565 scope.go:117] "RemoveContainer" containerID="a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0" Jun 05 13:33:30.441565 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441548 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0"} err="failed to get container status \"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0\": rpc error: code = NotFound desc = could not find container \"a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0\": container with ID starting with a35dab6d5dc9c7d35a543d0bf9f9677cef2bb598655e205f931ee065ae5e20e0 not found: ID does not exist" Jun 05 13:33:30.441614 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441565 2565 scope.go:117] "RemoveContainer" containerID="c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72" Jun 05 13:33:30.441768 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441750 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72"} err="failed to get container status \"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72\": rpc error: code = NotFound desc = could not find container \"c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72\": container with ID starting with c01af0991eafdbf70a248f408b8c7162f3962e99e9c47530ff730933c5a2ab72 not found: ID does not exist" Jun 05 13:33:30.441812 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441769 2565 scope.go:117] "RemoveContainer" containerID="cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5" Jun 05 13:33:30.442003 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.441979 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5"} err="failed to get container status \"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5\": rpc error: code = NotFound desc = could not find container \"cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5\": container with ID starting with cd96468b6896adfd63d02038341c015b57d17060dd84420aad143dca597a1fd5 not found: ID does not exist" Jun 05 13:33:30.445758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.445737 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:33:30.446011 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446000 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043c4836-e8cd-4499-bf6e-3c62af52d950" containerName="console" Jun 05 13:33:30.446063 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446012 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="043c4836-e8cd-4499-bf6e-3c62af52d950" containerName="console" Jun 05 13:33:30.446063 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446023 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy" Jun 05 13:33:30.446063 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446029 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy" Jun 05 13:33:30.446063 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446058 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="alertmanager" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446065 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="alertmanager" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446073 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-web" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446078 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-web" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446087 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446091 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446098 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="config-reloader" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446103 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="config-reloader" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446113 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446118 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446123 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="init-config-reloader" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446128 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="init-config-reloader" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446134 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-metric" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446139 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-metric" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446144 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="prom-label-proxy" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446150 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="prom-label-proxy" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446159 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446183 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446165 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446206 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446214 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="prom-label-proxy" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446220 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446226 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-metric" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446233 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="043c4836-e8cd-4499-bf6e-3c62af52d950" containerName="console" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446238 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446243 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="config-reloader" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446249 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="kube-rbac-proxy-web" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446254 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec38da22-88cd-495f-9330-6f05a8354956" containerName="alertmanager" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446302 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446307 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446354 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.446650 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.446360 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5089e0d-5589-46ad-8cc9-613350e6a6a5" containerName="registry" Jun 05 13:33:30.451234 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.451219 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.454178 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454117 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 13:33:30.454178 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 13:33:30.454178 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 13:33:30.454422 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 13:33:30.454422 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454136 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 13:33:30.454422 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 13:33:30.454616 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454547 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 13:33:30.454693 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454677 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7nsnw\"" Jun 05 13:33:30.454814 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.454794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 13:33:30.460697 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.460680 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 13:33:30.464289 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.464272 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:33:30.508753 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508753 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/880deafa-f1fa-4f06-8042-b48cf3b99778-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/880deafa-f1fa-4f06-8042-b48cf3b99778-tls-assets\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/880deafa-f1fa-4f06-8042-b48cf3b99778-config-out\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508865 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-web-config\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.508939 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-config-volume\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.509148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.509148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.508980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.509148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.509000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/880deafa-f1fa-4f06-8042-b48cf3b99778-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.509148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.509016 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/880deafa-f1fa-4f06-8042-b48cf3b99778-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.509148 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.509109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dl99\" (UniqueName: \"kubernetes.io/projected/880deafa-f1fa-4f06-8042-b48cf3b99778-kube-api-access-9dl99\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/880deafa-f1fa-4f06-8042-b48cf3b99778-tls-assets\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610232 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/880deafa-f1fa-4f06-8042-b48cf3b99778-config-out\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-web-config\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-config-volume\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610397 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/880deafa-f1fa-4f06-8042-b48cf3b99778-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/880deafa-f1fa-4f06-8042-b48cf3b99778-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610469 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dl99\" (UniqueName: \"kubernetes.io/projected/880deafa-f1fa-4f06-8042-b48cf3b99778-kube-api-access-9dl99\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610908 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610908 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/880deafa-f1fa-4f06-8042-b48cf3b99778-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.610908 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.610855 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/880deafa-f1fa-4f06-8042-b48cf3b99778-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.611850 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.611432 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/880deafa-f1fa-4f06-8042-b48cf3b99778-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.611850 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.611606 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/880deafa-f1fa-4f06-8042-b48cf3b99778-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.613402 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.613344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/880deafa-f1fa-4f06-8042-b48cf3b99778-config-out\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.613402 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.613364 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.613402 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.613363 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/880deafa-f1fa-4f06-8042-b48cf3b99778-tls-assets\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.613620 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.613516 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.613620 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.613570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-web-config\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.613801 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.613778 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-config-volume\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.614363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.614344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.614434 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.614416 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.615229 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.615214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/880deafa-f1fa-4f06-8042-b48cf3b99778-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.619341 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.619316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dl99\" (UniqueName: \"kubernetes.io/projected/880deafa-f1fa-4f06-8042-b48cf3b99778-kube-api-access-9dl99\") pod \"alertmanager-main-0\" (UID: \"880deafa-f1fa-4f06-8042-b48cf3b99778\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.760775 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.760729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 13:33:30.899161 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:30.899134 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 13:33:30.900997 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:33:30.900968 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880deafa_f1fa_4f06_8042_b48cf3b99778.slice/crio-b6a2b6171be9f455a67789f838c3ce4b8c9494d139ea7155b5495cf3a726caf7 WatchSource:0}: Error finding container b6a2b6171be9f455a67789f838c3ce4b8c9494d139ea7155b5495cf3a726caf7: Status 404 returned error can't find the container with id b6a2b6171be9f455a67789f838c3ce4b8c9494d139ea7155b5495cf3a726caf7 Jun 05 13:33:31.395097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:31.394993 2565 generic.go:356] "Generic (PLEG): container finished" podID="880deafa-f1fa-4f06-8042-b48cf3b99778" containerID="48364b0651d1f700bb51ceabed144d4cc5dac85ec67deafd9f5f3fb95c317094" exitCode=0 Jun 05 13:33:31.395097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:31.395057 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerDied","Data":"48364b0651d1f700bb51ceabed144d4cc5dac85ec67deafd9f5f3fb95c317094"} Jun 05 13:33:31.395592 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:31.395108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"b6a2b6171be9f455a67789f838c3ce4b8c9494d139ea7155b5495cf3a726caf7"} Jun 05 13:33:31.465597 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:31.465450 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec38da22-88cd-495f-9330-6f05a8354956" path="/var/lib/kubelet/pods/ec38da22-88cd-495f-9330-6f05a8354956/volumes" Jun 05 13:33:32.407843 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.407808 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"f7a7f949fc157b480e2a2de9a301f5c626ea1596d4053bbd8f55949891730a22"} Jun 05 13:33:32.408287 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.407893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"6c55d8148259a97394732ac6e7f7e2ae776554b93f1022eab2ad706aefda16f6"} Jun 05 13:33:32.408287 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.407918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"be5197e64997206ba9ea1c661199e93ae6628743c29a3a368a40208b849cf4da"} Jun 05 13:33:32.408287 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.407941 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"ee8de45483cdfcc0fca99caf3120b180b35e938bcb1c8666ebf2d71ca8f5cc2a"} Jun 05 13:33:32.408287 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.407964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"8cf5fe9fac22cc2b17db054e43d381a3289ae413e04229e8e563ae3bb8de2ba1"} Jun 05 13:33:32.408287 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.407988 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"880deafa-f1fa-4f06-8042-b48cf3b99778","Type":"ContainerStarted","Data":"21706eb39dc0084c8244e743b4e96ceec7f7c18328fb71f4743dae14a6f7437b"} Jun 05 13:33:32.434969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.434889 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4211773770000002 podStartE2EDuration="2.434870355s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.692978ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:33:32.433412478 +0000 UTC m=+551.377706813" watchObservedRunningTime="2026-06-05 13:33:32.434870355 +0000 UTC m=+551.379164666" Jun 05 13:33:32.910938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.910897 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:33:32.911357 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.911324 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="prometheus" containerID="cri-o://2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" gracePeriod=600 Jun 05 13:33:32.911533 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.911398 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="thanos-sidecar" containerID="cri-o://a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" gracePeriod=600 Jun 05 13:33:32.911533 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.911427 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" gracePeriod=600 Jun 05 13:33:32.911533 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.911441 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-web" containerID="cri-o://30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" gracePeriod=600 Jun 05 13:33:32.911533 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.911397 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy" containerID="cri-o://0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" gracePeriod=600 Jun 05 13:33:32.911533 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:32.911469 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="config-reloader" containerID="cri-o://f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" gracePeriod=600 Jun 05 13:33:33.179244 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.179218 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.233731 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233705 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-web-config\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233742 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v8js\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-kube-api-access-8v8js\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233768 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-tls\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233797 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-db\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233832 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-config\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233847 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-grpc-tls\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233872 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-kube-rbac-proxy\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.233902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233901 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-2\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233929 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-serving-certs-ca-bundle\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233963 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.233987 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-metrics-client-certs\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234026 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-kubelet-serving-ca-bundle\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234066 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-thanos-prometheus-http-client-file\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234105 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-0\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234143 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-tls-assets\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234164 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234187 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-metrics-client-ca\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234726 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234279 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-1\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234726 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234307 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-config-out\") pod \"1eabf43a-6232-4a1a-9022-d984fb80f835\" (UID: \"1eabf43a-6232-4a1a-9022-d984fb80f835\") " Jun 05 13:33:33.234838 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234813 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.234892 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.234871 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:33:33.235268 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.235242 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.237403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.236622 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.237403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.236927 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.237403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.236999 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-config-out" (OuterVolumeSpecName: "config-out") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:33:33.237403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.237083 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-config" (OuterVolumeSpecName: "config") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.237403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.237358 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.239018 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.237810 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.239018 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.237994 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.239018 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.238802 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.239265 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.239195 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:33:33.239419 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.239392 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-kube-api-access-8v8js" (OuterVolumeSpecName: "kube-api-access-8v8js") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "kube-api-access-8v8js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:33:33.239509 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.239400 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.239763 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.239735 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:33:33.240295 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.240250 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.240295 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.240268 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.240842 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.240807 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.241282 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.241098 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.252065 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.252022 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-web-config" (OuterVolumeSpecName: "web-config") pod "1eabf43a-6232-4a1a-9022-d984fb80f835" (UID: "1eabf43a-6232-4a1a-9022-d984fb80f835"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:33:33.335401 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335368 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-config\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335401 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335393 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-grpc-tls\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335401 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335405 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-kube-rbac-proxy\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335414 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335424 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335432 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335440 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-metrics-client-certs\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335450 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335458 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335468 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335476 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-tls-assets\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335484 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335494 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335502 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-configmap-metrics-client-ca\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335511 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335519 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-config-out\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335527 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-web-config\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335536 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v8js\" (UniqueName: \"kubernetes.io/projected/1eabf43a-6232-4a1a-9022-d984fb80f835-kube-api-access-8v8js\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335544 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1eabf43a-6232-4a1a-9022-d984fb80f835-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.335599 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.335552 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1eabf43a-6232-4a1a-9022-d984fb80f835-prometheus-k8s-db\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:33:33.414202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414168 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" exitCode=0 Jun 05 13:33:33.414202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414193 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" exitCode=0 Jun 05 13:33:33.414202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414200 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" exitCode=0 Jun 05 13:33:33.414202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414207 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" exitCode=0 Jun 05 13:33:33.414202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414213 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" exitCode=0 Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414219 2565 generic.go:356] "Generic (PLEG): container finished" podID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" exitCode=0 Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414241 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414249 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414346 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414378 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414383 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414458 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} Jun 05 13:33:33.414749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.414496 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1eabf43a-6232-4a1a-9022-d984fb80f835","Type":"ContainerDied","Data":"8ca7799f8c79dd0b412f0a40e3bb5d135ffa4e584e0cc6a2611095cabd3e894a"} Jun 05 13:33:33.422815 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.422790 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.430007 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.429992 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.436388 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.436369 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.441591 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.441565 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:33:33.443658 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.443643 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.448046 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.448015 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:33:33.450341 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.450327 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.458525 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.458509 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.464312 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.464290 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" path="/var/lib/kubelet/pods/1eabf43a-6232-4a1a-9022-d984fb80f835/volumes" Jun 05 13:33:33.466190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466176 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.466442 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.466424 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.466510 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466452 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} err="failed to get container status \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" Jun 05 13:33:33.466510 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466473 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.466703 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.466687 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.466744 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466710 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} err="failed to get container status \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" Jun 05 13:33:33.466744 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466725 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.466923 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.466904 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.466968 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466929 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} err="failed to get container status \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" Jun 05 13:33:33.466968 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.466944 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.467222 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.467205 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.467279 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467226 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} err="failed to get container status \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" Jun 05 13:33:33.467279 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467240 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.467420 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.467404 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.467465 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467424 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} err="failed to get container status \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" Jun 05 13:33:33.467465 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467436 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.467608 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.467590 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.467643 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467612 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} err="failed to get container status \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" Jun 05 13:33:33.467643 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467625 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.467795 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:33:33.467779 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.467834 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467797 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} err="failed to get container status \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" Jun 05 13:33:33.467834 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467808 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.467978 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467962 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} err="failed to get container status \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" Jun 05 13:33:33.468015 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.467979 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.468181 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468163 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} err="failed to get container status \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" Jun 05 13:33:33.468223 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468182 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.468414 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468386 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} err="failed to get container status \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" Jun 05 13:33:33.468414 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468407 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.468597 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468577 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} err="failed to get container status \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" Jun 05 13:33:33.468646 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468598 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.468759 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468741 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} err="failed to get container status \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" Jun 05 13:33:33.468800 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468761 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.468937 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468923 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} err="failed to get container status \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" Jun 05 13:33:33.468979 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.468936 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.469181 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469166 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} err="failed to get container status \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" Jun 05 13:33:33.469255 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469182 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.469447 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469428 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} err="failed to get container status \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" Jun 05 13:33:33.469511 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469447 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.469642 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469626 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} err="failed to get container status \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" Jun 05 13:33:33.469642 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469640 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.469853 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469833 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} err="failed to get container status \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" Jun 05 13:33:33.469925 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.469854 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.470064 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470032 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} err="failed to get container status \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" Jun 05 13:33:33.470064 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470063 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.470236 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470217 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} err="failed to get container status \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" Jun 05 13:33:33.470273 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470238 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.470444 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470423 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} err="failed to get container status \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" Jun 05 13:33:33.470444 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470442 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.470685 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470667 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} err="failed to get container status \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" Jun 05 13:33:33.470749 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470686 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.470891 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470870 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} err="failed to get container status \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" Jun 05 13:33:33.470975 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.470891 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.471112 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471095 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} err="failed to get container status \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" Jun 05 13:33:33.471156 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471113 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.471316 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471300 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} err="failed to get container status \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" Jun 05 13:33:33.471364 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471317 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.471548 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471494 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} err="failed to get container status \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" Jun 05 13:33:33.471548 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471513 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.471943 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471850 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} err="failed to get container status \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" Jun 05 13:33:33.471943 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.471876 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.472159 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472132 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} err="failed to get container status \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" Jun 05 13:33:33.472159 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472149 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.472436 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472410 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} err="failed to get container status \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" Jun 05 13:33:33.472527 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472437 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.472672 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472650 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} err="failed to get container status \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" Jun 05 13:33:33.472672 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472670 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.472938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472919 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} err="failed to get container status \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" Jun 05 13:33:33.473018 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.472940 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.473330 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.473300 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} err="failed to get container status \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" Jun 05 13:33:33.473330 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.473329 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.473635 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.473607 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} err="failed to get container status \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" Jun 05 13:33:33.473718 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.473641 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.473978 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.473959 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} err="failed to get container status \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" Jun 05 13:33:33.474066 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.473979 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.474119 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474087 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:33:33.474245 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474228 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} err="failed to get container status \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" Jun 05 13:33:33.474285 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474245 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.474413 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474400 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy" Jun 05 13:33:33.474448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474417 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy" Jun 05 13:33:33.474448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474427 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-thanos" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474447 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-thanos" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474464 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="prometheus" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474472 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="prometheus" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474442 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} err="failed to get container status \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474486 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-web" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474488 2565 scope.go:117] "RemoveContainer" containerID="c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474492 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-web" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474499 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="config-reloader" Jun 05 13:33:33.474508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474504 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="config-reloader" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474512 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="thanos-sidecar" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474517 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="thanos-sidecar" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474524 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="init-config-reloader" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474530 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="init-config-reloader" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474594 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="config-reloader" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474608 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="prometheus" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474617 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="thanos-sidecar" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474626 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-web" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474635 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474642 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eabf43a-6232-4a1a-9022-d984fb80f835" containerName="kube-rbac-proxy-thanos" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474689 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a"} err="failed to get container status \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": rpc error: code = NotFound desc = could not find container \"c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a\": container with ID starting with c266e622eb1564e2210f647ee9c3caa0663c8be816cfc23956b33e0d16a9c00a not found: ID does not exist" Jun 05 13:33:33.474803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474704 2565 scope.go:117] "RemoveContainer" containerID="0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45" Jun 05 13:33:33.475233 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474905 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45"} err="failed to get container status \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": rpc error: code = NotFound desc = could not find container \"0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45\": container with ID starting with 0d6a3a53853237c26bf459b8e758ba9f22b7afc3f2bea6d07c6b36e322928c45 not found: ID does not exist" Jun 05 13:33:33.475233 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.474919 2565 scope.go:117] "RemoveContainer" containerID="30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2" Jun 05 13:33:33.475233 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475145 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2"} err="failed to get container status \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": rpc error: code = NotFound desc = could not find container \"30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2\": container with ID starting with 30d844d15cb458822c3df8034ef9fe1f04be994155f6911b7827a14324c728a2 not found: ID does not exist" Jun 05 13:33:33.475233 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475160 2565 scope.go:117] "RemoveContainer" containerID="a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5" Jun 05 13:33:33.475394 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475343 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5"} err="failed to get container status \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": rpc error: code = NotFound desc = could not find container \"a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5\": container with ID starting with a76abe689062cf1cdf809db63e4e7886b1c1ef85b44c11c764963a1e9660fee5 not found: ID does not exist" Jun 05 13:33:33.475394 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475358 2565 scope.go:117] "RemoveContainer" containerID="f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c" Jun 05 13:33:33.475568 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475553 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c"} err="failed to get container status \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": rpc error: code = NotFound desc = could not find container \"f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c\": container with ID starting with f21193395844db2b546df364d6d700f9a06114f7cca1cd51a05912d2d30a498c not found: ID does not exist" Jun 05 13:33:33.475611 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475568 2565 scope.go:117] "RemoveContainer" containerID="2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8" Jun 05 13:33:33.475782 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475767 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8"} err="failed to get container status \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": rpc error: code = NotFound desc = could not find container \"2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8\": container with ID starting with 2096f190e8c0a4a441e6352f9d6bc7d19058669145442aef6029b4cf5e4ad0d8 not found: ID does not exist" Jun 05 13:33:33.475833 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475783 2565 scope.go:117] "RemoveContainer" containerID="6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d" Jun 05 13:33:33.475995 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.475980 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d"} err="failed to get container status \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": rpc error: code = NotFound desc = could not find container \"6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d\": container with ID starting with 6349462d49f13884a0ece0699986fe6ad41d680231403b35fc85cdfd36ef405d not found: ID does not exist" Jun 05 13:33:33.480703 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.480685 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.483432 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483409 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 13:33:33.483517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483409 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 13:33:33.483517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483445 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 13:33:33.483517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483448 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d13n1vkuaseba\"" Jun 05 13:33:33.483517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483455 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 13:33:33.483875 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483857 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 13:33:33.484023 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.483974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 13:33:33.484023 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-gn2h9\"" Jun 05 13:33:33.484201 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484116 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 13:33:33.484201 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484116 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 13:33:33.484201 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484128 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 13:33:33.484403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484375 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 13:33:33.484504 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484488 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 13:33:33.484736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484714 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 13:33:33.484816 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.484743 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 13:33:33.495203 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.494624 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 13:33:33.496367 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.496338 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 13:33:33.497204 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.497170 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:33:33.536900 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.536873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537031 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.536903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537146 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537201 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537314 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537404 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537404 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpq9v\" (UniqueName: \"kubernetes.io/projected/4c654c2d-ff0f-4571-a572-48f70ad39498-kube-api-access-fpq9v\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537514 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537563 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537563 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-config\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537563 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537553 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537602 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537809 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537888 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c654c2d-ff0f-4571-a572-48f70ad39498-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.537979 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.537962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.538096 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.538079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.538176 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.538119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.538252 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.538229 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c654c2d-ff0f-4571-a572-48f70ad39498-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.538323 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.538285 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.538323 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.538301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639293 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639293 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c654c2d-ff0f-4571-a572-48f70ad39498-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c654c2d-ff0f-4571-a572-48f70ad39498-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639435 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.639580 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpq9v\" (UniqueName: \"kubernetes.io/projected/4c654c2d-ff0f-4571-a572-48f70ad39498-kube-api-access-fpq9v\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-config\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640140 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.639793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640470 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.640156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.640470 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.640381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.642751 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642422 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4c654c2d-ff0f-4571-a572-48f70ad39498-config-out\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.642751 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642522 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.642751 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642547 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.642751 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4c654c2d-ff0f-4571-a572-48f70ad39498-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.642751 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642681 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.642751 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642714 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.643130 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.642786 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.643190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.643161 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.643249 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.643204 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-web-config\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.643249 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.643231 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.643776 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.643752 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.644105 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.644085 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.644216 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.644191 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c654c2d-ff0f-4571-a572-48f70ad39498-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.644750 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.644727 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.645080 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.645061 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.645464 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.645443 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.645534 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.645445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4c654c2d-ff0f-4571-a572-48f70ad39498-config\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.651333 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.651315 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpq9v\" (UniqueName: \"kubernetes.io/projected/4c654c2d-ff0f-4571-a572-48f70ad39498-kube-api-access-fpq9v\") pod \"prometheus-k8s-0\" (UID: \"4c654c2d-ff0f-4571-a572-48f70ad39498\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.795508 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.795473 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:33:33.937969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:33.937943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 13:33:33.939937 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:33:33.939908 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c654c2d_ff0f_4571_a572_48f70ad39498.slice/crio-7030999ef29aca63cab5c8a2356a239c2e52de04592de8f4cda6400a96768941 WatchSource:0}: Error finding container 7030999ef29aca63cab5c8a2356a239c2e52de04592de8f4cda6400a96768941: Status 404 returned error can't find the container with id 7030999ef29aca63cab5c8a2356a239c2e52de04592de8f4cda6400a96768941 Jun 05 13:33:34.419365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:34.419328 2565 generic.go:356] "Generic (PLEG): container finished" podID="4c654c2d-ff0f-4571-a572-48f70ad39498" containerID="c3e25a846d4b76195f272d8a96c9fe6d3201735e4224148c5d48d7d7d65b64c6" exitCode=0 Jun 05 13:33:34.419798 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:34.419412 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerDied","Data":"c3e25a846d4b76195f272d8a96c9fe6d3201735e4224148c5d48d7d7d65b64c6"} Jun 05 13:33:34.419798 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:34.419482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"7030999ef29aca63cab5c8a2356a239c2e52de04592de8f4cda6400a96768941"} Jun 05 13:33:35.427341 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.427306 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"6cb464ce420e6e85fa5e3416bdcc83b6d59fe51ff6b6c51db5c3df60b7684f9d"} Jun 05 13:33:35.427794 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.427368 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"9777018f35fab684914a83744f0e62746b03a2ec561180469967f527525c3693"} Jun 05 13:33:35.427794 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.427417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"ca4227bf2de39e336214dd89d1d664ec5ae705980765e573515aebdc1b925b53"} Jun 05 13:33:35.427794 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.427443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"120b4147e0d95caeea8e9b66b0fb22084c2bf807054cc0ceee4f45ea9b9fd6bb"} Jun 05 13:33:35.427794 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.427470 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"e850b405eac29196a03aa624e01af9e6552213c3a3a46c80e6a240f6eedd85d5"} Jun 05 13:33:35.427794 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.427495 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4c654c2d-ff0f-4571-a572-48f70ad39498","Type":"ContainerStarted","Data":"63eadc981dd895564a140e65d99bdfa1b30cd713202cbb63a1069f9ba6da6284"} Jun 05 13:33:35.457984 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:35.457927 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.435816645 podStartE2EDuration="2.45790789s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.091245ms" isStatefulPod=false podCreationTimestamp="2026-06-05 13:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:33:35.456126459 +0000 UTC m=+554.400420770" watchObservedRunningTime="2026-06-05 13:33:35.45790789 +0000 UTC m=+554.402202199" Jun 05 13:33:38.796150 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:33:38.796111 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:34:21.430165 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:21.430138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:34:21.430165 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:21.430150 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:34:21.438466 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:21.438448 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:34:21.438607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:21.438450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:34:33.796477 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:33.796448 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:34:33.811441 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:33.811409 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:34:34.669018 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:34:34.668989 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 13:38:45.547679 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.547645 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl"] Jun 05 13:38:45.550810 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.550795 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.553372 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.553339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 13:38:45.553499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.553439 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 13:38:45.554251 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.554232 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2x8ll\"" Jun 05 13:38:45.560359 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.560341 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl"] Jun 05 13:38:45.647806 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.647782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672fd164-83e7-4a59-a4d0-6da7bfec485b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-nqqkl\" (UID: \"672fd164-83e7-4a59-a4d0-6da7bfec485b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.647929 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.647842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fllwl\" (UniqueName: \"kubernetes.io/projected/672fd164-83e7-4a59-a4d0-6da7bfec485b-kube-api-access-fllwl\") pod \"cert-manager-cainjector-5d99449ffd-nqqkl\" (UID: \"672fd164-83e7-4a59-a4d0-6da7bfec485b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.749097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.749008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fllwl\" (UniqueName: \"kubernetes.io/projected/672fd164-83e7-4a59-a4d0-6da7bfec485b-kube-api-access-fllwl\") pod \"cert-manager-cainjector-5d99449ffd-nqqkl\" (UID: \"672fd164-83e7-4a59-a4d0-6da7bfec485b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.749202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.749156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672fd164-83e7-4a59-a4d0-6da7bfec485b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-nqqkl\" (UID: \"672fd164-83e7-4a59-a4d0-6da7bfec485b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.768116 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.768087 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672fd164-83e7-4a59-a4d0-6da7bfec485b-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-nqqkl\" (UID: \"672fd164-83e7-4a59-a4d0-6da7bfec485b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.769156 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.769131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fllwl\" (UniqueName: \"kubernetes.io/projected/672fd164-83e7-4a59-a4d0-6da7bfec485b-kube-api-access-fllwl\") pod \"cert-manager-cainjector-5d99449ffd-nqqkl\" (UID: \"672fd164-83e7-4a59-a4d0-6da7bfec485b\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:45.868972 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:45.868908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" Jun 05 13:38:46.009480 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:46.009371 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl"] Jun 05 13:38:46.012093 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:38:46.012068 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod672fd164_83e7_4a59_a4d0_6da7bfec485b.slice/crio-2e281d2a473ed1ef5ed776855259e4ddbb73a4a1d7d938ad451224336461cea2 WatchSource:0}: Error finding container 2e281d2a473ed1ef5ed776855259e4ddbb73a4a1d7d938ad451224336461cea2: Status 404 returned error can't find the container with id 2e281d2a473ed1ef5ed776855259e4ddbb73a4a1d7d938ad451224336461cea2 Jun 05 13:38:46.014033 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:46.014017 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:38:46.605644 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:46.605591 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" event={"ID":"672fd164-83e7-4a59-a4d0-6da7bfec485b","Type":"ContainerStarted","Data":"2e281d2a473ed1ef5ed776855259e4ddbb73a4a1d7d938ad451224336461cea2"} Jun 05 13:38:54.639579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:54.639544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" event={"ID":"672fd164-83e7-4a59-a4d0-6da7bfec485b","Type":"ContainerStarted","Data":"cb5a5f80d625ab2ea88af6969e577c384a972b8e57ab6c12a1d469f07c04bc59"} Jun 05 13:38:54.654854 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:38:54.654799 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-nqqkl" podStartSLOduration=1.108697899 podStartE2EDuration="9.654779189s" totalImagesPullingTime="8.54608129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:38:54.654063127 +0000 UTC m=+873.598357433" watchObservedRunningTime="2026-06-05 13:38:54.654779189 +0000 UTC m=+873.599073498" Jun 05 13:39:18.728120 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.728084 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72"] Jun 05 13:39:18.731337 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.731316 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.735116 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.735094 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 13:39:18.735323 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.735308 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 13:39:18.735387 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.735328 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 13:39:18.735435 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.735328 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gbf66\"" Jun 05 13:39:18.735635 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.735619 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 13:39:18.742911 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.742888 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72"] Jun 05 13:39:18.840577 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.840544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-manifests\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.840758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.840588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.840758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.840627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.840758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.840645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-tmp\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.840758 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.840670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqssl\" (UniqueName: \"kubernetes.io/projected/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-kube-api-access-bqssl\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.942088 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.942030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.942294 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.942123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.942294 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.942155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-tmp\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.942294 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.942194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqssl\" (UniqueName: \"kubernetes.io/projected/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-kube-api-access-bqssl\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.942294 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.942256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-manifests\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.942701 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.942668 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-manifests\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.944517 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.944496 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-tmp\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.944730 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.944708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.944786 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.944708 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:18.950351 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:18.950328 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqssl\" (UniqueName: \"kubernetes.io/projected/bb04e35b-1bdc-4e5d-a2ed-6a905579209b-kube-api-access-bqssl\") pod \"opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72\" (UID: \"bb04e35b-1bdc-4e5d-a2ed-6a905579209b\") " pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:19.042797 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:19.042697 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:19.180902 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:19.180875 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72"] Jun 05 13:39:19.183454 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:39:19.183417 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb04e35b_1bdc_4e5d_a2ed_6a905579209b.slice/crio-5e2052a660fa1da3af59637dc7f9a4a008c3947846c0760e3d84e61cf4ab50d6 WatchSource:0}: Error finding container 5e2052a660fa1da3af59637dc7f9a4a008c3947846c0760e3d84e61cf4ab50d6: Status 404 returned error can't find the container with id 5e2052a660fa1da3af59637dc7f9a4a008c3947846c0760e3d84e61cf4ab50d6 Jun 05 13:39:19.741743 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:19.741700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" event={"ID":"bb04e35b-1bdc-4e5d-a2ed-6a905579209b","Type":"ContainerStarted","Data":"5e2052a660fa1da3af59637dc7f9a4a008c3947846c0760e3d84e61cf4ab50d6"} Jun 05 13:39:21.965583 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:21.965557 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:39:21.966064 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:21.965892 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:39:21.974109 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:21.974089 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:39:21.974426 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:21.974408 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:39:22.758193 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:22.758156 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" event={"ID":"bb04e35b-1bdc-4e5d-a2ed-6a905579209b","Type":"ContainerStarted","Data":"b049feca7a12f788caa6db51c40ff2083c98c14cd733d451dbab28712197435b"} Jun 05 13:39:23.763727 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:23.763693 2565 generic.go:356] "Generic (PLEG): container finished" podID="bb04e35b-1bdc-4e5d-a2ed-6a905579209b" containerID="b049feca7a12f788caa6db51c40ff2083c98c14cd733d451dbab28712197435b" exitCode=0 Jun 05 13:39:23.764132 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:23.763792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" event={"ID":"bb04e35b-1bdc-4e5d-a2ed-6a905579209b","Type":"ContainerDied","Data":"b049feca7a12f788caa6db51c40ff2083c98c14cd733d451dbab28712197435b"} Jun 05 13:39:24.770511 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:24.770477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" event={"ID":"bb04e35b-1bdc-4e5d-a2ed-6a905579209b","Type":"ContainerStarted","Data":"0e3aeb49ee8b17f1013e4989340948906ef81a2271a9ddd7f9e98e9fa5b45101"} Jun 05 13:39:24.770955 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:24.770626 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:24.792202 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:24.792154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" podStartSLOduration=2.642441264 podStartE2EDuration="6.792138481s" totalImagesPullingTime="3.129091957s" totalInitContainerRuntime="1.02060526s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:39:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:39:24.791551105 +0000 UTC m=+903.735845440" watchObservedRunningTime="2026-06-05 13:39:24.792138481 +0000 UTC m=+903.736432848" Jun 05 13:39:35.779571 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:35.779542 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72" Jun 05 13:39:38.231490 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.231454 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-686f455b98-p95hb"] Jun 05 13:39:38.234767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.234747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.238929 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.238907 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 13:39:38.239075 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.238933 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-76jt6\"" Jun 05 13:39:38.239075 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.238973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 13:39:38.239075 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.238911 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 13:39:38.239075 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.238908 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 13:39:38.239275 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.238907 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 13:39:38.248344 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.248325 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686f455b98-p95hb"] Jun 05 13:39:38.310767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.310739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79541f28-eafb-4f37-97f5-ac03fc80914b-metrics-cert\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.310950 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.310791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj8w7\" (UniqueName: \"kubernetes.io/projected/79541f28-eafb-4f37-97f5-ac03fc80914b-kube-api-access-fj8w7\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.310950 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.310860 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79541f28-eafb-4f37-97f5-ac03fc80914b-manager-config\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.310950 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.310883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79541f28-eafb-4f37-97f5-ac03fc80914b-cert\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.411808 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.411779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79541f28-eafb-4f37-97f5-ac03fc80914b-metrics-cert\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.411987 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.411836 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj8w7\" (UniqueName: \"kubernetes.io/projected/79541f28-eafb-4f37-97f5-ac03fc80914b-kube-api-access-fj8w7\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.411987 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.411864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79541f28-eafb-4f37-97f5-ac03fc80914b-manager-config\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.411987 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.411882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79541f28-eafb-4f37-97f5-ac03fc80914b-cert\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.412579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.412556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/79541f28-eafb-4f37-97f5-ac03fc80914b-manager-config\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.414282 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.414253 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79541f28-eafb-4f37-97f5-ac03fc80914b-cert\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.414364 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.414315 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/79541f28-eafb-4f37-97f5-ac03fc80914b-metrics-cert\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.420898 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.420877 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj8w7\" (UniqueName: \"kubernetes.io/projected/79541f28-eafb-4f37-97f5-ac03fc80914b-kube-api-access-fj8w7\") pod \"lws-controller-manager-686f455b98-p95hb\" (UID: \"79541f28-eafb-4f37-97f5-ac03fc80914b\") " pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.544348 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.544256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:38.680162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.680049 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-686f455b98-p95hb"] Jun 05 13:39:38.682976 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:39:38.682947 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79541f28_eafb_4f37_97f5_ac03fc80914b.slice/crio-a07cf6f912865ccc9b14f77a555ddf599dfd8164e854f8269220c81a1d39cae6 WatchSource:0}: Error finding container a07cf6f912865ccc9b14f77a555ddf599dfd8164e854f8269220c81a1d39cae6: Status 404 returned error can't find the container with id a07cf6f912865ccc9b14f77a555ddf599dfd8164e854f8269220c81a1d39cae6 Jun 05 13:39:38.835767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:38.835690 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" event={"ID":"79541f28-eafb-4f37-97f5-ac03fc80914b","Type":"ContainerStarted","Data":"a07cf6f912865ccc9b14f77a555ddf599dfd8164e854f8269220c81a1d39cae6"} Jun 05 13:39:41.856403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:41.856367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" event={"ID":"79541f28-eafb-4f37-97f5-ac03fc80914b","Type":"ContainerStarted","Data":"6509b8de4bb9926aa668a639cf2bb0c18f4bbaa165cb934b75ba6083354c54b2"} Jun 05 13:39:41.856872 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:41.856461 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:39:41.873482 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:41.873429 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" podStartSLOduration=1.519575962 podStartE2EDuration="3.873413273s" totalImagesPullingTime="2.353837311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:39:41.8718343 +0000 UTC m=+920.816128610" watchObservedRunningTime="2026-06-05 13:39:41.873413273 +0000 UTC m=+920.817707648" Jun 05 13:39:52.862615 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:39:52.862584 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-686f455b98-p95hb" Jun 05 13:40:11.580714 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.580676 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc"] Jun 05 13:40:11.593872 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.593842 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.596620 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.596596 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 13:40:11.597208 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.596593 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 13:40:11.597724 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.597699 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6ms4s\"" Jun 05 13:40:11.597914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.597736 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 13:40:11.599765 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.599737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc"] Jun 05 13:40:11.610156 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f2a2c1b-da53-4e2b-80d9-82333a311712-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610262 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610262 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610262 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610375 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610378 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610447 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610404 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47r4z\" (UniqueName: \"kubernetes.io/projected/0f2a2c1b-da53-4e2b-80d9-82333a311712-kube-api-access-47r4z\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610447 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.610512 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.610470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.711736 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.711699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.711938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.711786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.711938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.711829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.711938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.711858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47r4z\" (UniqueName: \"kubernetes.io/projected/0f2a2c1b-da53-4e2b-80d9-82333a311712-kube-api-access-47r4z\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712157 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712157 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712157 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f2a2c1b-da53-4e2b-80d9-82333a311712-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712156 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712193 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712207 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712396 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712556 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.712859 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.712810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f2a2c1b-da53-4e2b-80d9-82333a311712-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.714600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.714577 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.714701 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.714628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.720328 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.720303 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f2a2c1b-da53-4e2b-80d9-82333a311712-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.720487 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.720470 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47r4z\" (UniqueName: \"kubernetes.io/projected/0f2a2c1b-da53-4e2b-80d9-82333a311712-kube-api-access-47r4z\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rbscc\" (UID: \"0f2a2c1b-da53-4e2b-80d9-82333a311712\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:11.906213 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:11.906124 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:12.039850 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:12.039813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc"] Jun 05 13:40:12.042414 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:40:12.042386 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f2a2c1b_da53_4e2b_80d9_82333a311712.slice/crio-35615d402ed4a1d531c3296bc7eef7584ea21f8dc5a5782e0da344af55dc3605 WatchSource:0}: Error finding container 35615d402ed4a1d531c3296bc7eef7584ea21f8dc5a5782e0da344af55dc3605: Status 404 returned error can't find the container with id 35615d402ed4a1d531c3296bc7eef7584ea21f8dc5a5782e0da344af55dc3605 Jun 05 13:40:12.992015 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:12.991970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" event={"ID":"0f2a2c1b-da53-4e2b-80d9-82333a311712","Type":"ContainerStarted","Data":"35615d402ed4a1d531c3296bc7eef7584ea21f8dc5a5782e0da344af55dc3605"} Jun 05 13:40:15.747255 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:15.747206 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:40:15.747546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:15.747295 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:40:15.747546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:15.747328 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:40:16.006808 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.006718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" event={"ID":"0f2a2c1b-da53-4e2b-80d9-82333a311712","Type":"ContainerStarted","Data":"db6e19ab7c7497c853f9cf54aaa55b061c245501240bef500921f000e8158487"} Jun 05 13:40:16.027592 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.027538 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" podStartSLOduration=1.325420432 podStartE2EDuration="5.027518784s" totalImagesPullingTime="3.702098352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:40:16.026801422 +0000 UTC m=+954.971095747" watchObservedRunningTime="2026-06-05 13:40:16.027518784 +0000 UTC m=+954.971813093" Jun 05 13:40:16.400303 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.400226 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-75f4c87df8-f78xl"] Jun 05 13:40:16.403841 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.403819 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.406386 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.406363 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 13:40:16.406514 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.406397 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-2bwzf\"" Jun 05 13:40:16.414817 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.414791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-75f4c87df8-f78xl"] Jun 05 13:40:16.458970 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.458919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/84eef86a-923e-45da-90b6-96607c1a604b-redirect-config\") pod \"dashboard-redirect-75f4c87df8-f78xl\" (UID: \"84eef86a-923e-45da-90b6-96607c1a604b\") " pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.459182 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.459009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh9sc\" (UniqueName: \"kubernetes.io/projected/84eef86a-923e-45da-90b6-96607c1a604b-kube-api-access-vh9sc\") pod \"dashboard-redirect-75f4c87df8-f78xl\" (UID: \"84eef86a-923e-45da-90b6-96607c1a604b\") " pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.560191 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.560159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh9sc\" (UniqueName: \"kubernetes.io/projected/84eef86a-923e-45da-90b6-96607c1a604b-kube-api-access-vh9sc\") pod \"dashboard-redirect-75f4c87df8-f78xl\" (UID: \"84eef86a-923e-45da-90b6-96607c1a604b\") " pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.560399 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.560367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/84eef86a-923e-45da-90b6-96607c1a604b-redirect-config\") pod \"dashboard-redirect-75f4c87df8-f78xl\" (UID: \"84eef86a-923e-45da-90b6-96607c1a604b\") " pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.561166 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.561139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/84eef86a-923e-45da-90b6-96607c1a604b-redirect-config\") pod \"dashboard-redirect-75f4c87df8-f78xl\" (UID: \"84eef86a-923e-45da-90b6-96607c1a604b\") " pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.568435 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.568414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh9sc\" (UniqueName: \"kubernetes.io/projected/84eef86a-923e-45da-90b6-96607c1a604b-kube-api-access-vh9sc\") pod \"dashboard-redirect-75f4c87df8-f78xl\" (UID: \"84eef86a-923e-45da-90b6-96607c1a604b\") " pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.715739 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.715705 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" Jun 05 13:40:16.840731 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.840705 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-75f4c87df8-f78xl"] Jun 05 13:40:16.843071 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:40:16.843024 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84eef86a_923e_45da_90b6_96607c1a604b.slice/crio-d1d1c31a60633b14ed306c2b7e2e8adf429785f38d66a4a4ec105b43655f4ad2 WatchSource:0}: Error finding container d1d1c31a60633b14ed306c2b7e2e8adf429785f38d66a4a4ec105b43655f4ad2: Status 404 returned error can't find the container with id d1d1c31a60633b14ed306c2b7e2e8adf429785f38d66a4a4ec105b43655f4ad2 Jun 05 13:40:16.906567 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.906536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:16.911512 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:16.911489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:17.012152 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:17.012061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" event={"ID":"84eef86a-923e-45da-90b6-96607c1a604b","Type":"ContainerStarted","Data":"d1d1c31a60633b14ed306c2b7e2e8adf429785f38d66a4a4ec105b43655f4ad2"} Jun 05 13:40:17.012313 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:17.012297 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:17.013351 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:17.013334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rbscc" Jun 05 13:40:19.026120 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:19.024019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" event={"ID":"84eef86a-923e-45da-90b6-96607c1a604b","Type":"ContainerStarted","Data":"9114d7fd08f54539fc992b68276bb3cf5c8b05ab168480e6dfc4401121e92cd6"} Jun 05 13:40:19.043523 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:19.043469 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-75f4c87df8-f78xl" podStartSLOduration=1.1359267769999999 podStartE2EDuration="3.043453082s" totalImagesPullingTime="1.907526305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:40:19.041991861 +0000 UTC m=+957.986286199" watchObservedRunningTime="2026-06-05 13:40:19.043453082 +0000 UTC m=+957.987747391" Jun 05 13:40:39.220327 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.220289 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwp2"] Jun 05 13:40:39.224891 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.224876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:39.229448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.229336 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 13:40:39.229448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.229378 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 13:40:39.229448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.229421 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2dbw5\"" Jun 05 13:40:39.232724 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.232702 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwp2"] Jun 05 13:40:39.372893 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.372861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwmqv\" (UniqueName: \"kubernetes.io/projected/31704c16-fd54-4434-ab6e-2560ecce64e9-kube-api-access-pwmqv\") pod \"kuadrant-operator-catalog-gqwp2\" (UID: \"31704c16-fd54-4434-ab6e-2560ecce64e9\") " pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:39.473529 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.473438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwmqv\" (UniqueName: \"kubernetes.io/projected/31704c16-fd54-4434-ab6e-2560ecce64e9-kube-api-access-pwmqv\") pod \"kuadrant-operator-catalog-gqwp2\" (UID: \"31704c16-fd54-4434-ab6e-2560ecce64e9\") " pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:39.481283 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.481259 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwmqv\" (UniqueName: \"kubernetes.io/projected/31704c16-fd54-4434-ab6e-2560ecce64e9-kube-api-access-pwmqv\") pod \"kuadrant-operator-catalog-gqwp2\" (UID: \"31704c16-fd54-4434-ab6e-2560ecce64e9\") " pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:39.536340 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.536310 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:39.588029 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.587951 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwp2"] Jun 05 13:40:39.667998 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.667972 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwp2"] Jun 05 13:40:39.669901 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:40:39.669872 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31704c16_fd54_4434_ab6e_2560ecce64e9.slice/crio-6c7d5ca29baac7b44abd1737a4b45e7c3313bc58a32ebe303dfa91b6e06d8535 WatchSource:0}: Error finding container 6c7d5ca29baac7b44abd1737a4b45e7c3313bc58a32ebe303dfa91b6e06d8535: Status 404 returned error can't find the container with id 6c7d5ca29baac7b44abd1737a4b45e7c3313bc58a32ebe303dfa91b6e06d8535 Jun 05 13:40:39.795863 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.795773 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gn22q"] Jun 05 13:40:39.800641 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.800617 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:39.806134 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.806106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gn22q"] Jun 05 13:40:39.978630 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:39.978597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psh5c\" (UniqueName: \"kubernetes.io/projected/ddc1bcdb-2e6a-4471-8108-ff30d8c80d24-kube-api-access-psh5c\") pod \"kuadrant-operator-catalog-gn22q\" (UID: \"ddc1bcdb-2e6a-4471-8108-ff30d8c80d24\") " pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:40.079374 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:40.079286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psh5c\" (UniqueName: \"kubernetes.io/projected/ddc1bcdb-2e6a-4471-8108-ff30d8c80d24-kube-api-access-psh5c\") pod \"kuadrant-operator-catalog-gn22q\" (UID: \"ddc1bcdb-2e6a-4471-8108-ff30d8c80d24\") " pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:40.087785 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:40.087763 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psh5c\" (UniqueName: \"kubernetes.io/projected/ddc1bcdb-2e6a-4471-8108-ff30d8c80d24-kube-api-access-psh5c\") pod \"kuadrant-operator-catalog-gn22q\" (UID: \"ddc1bcdb-2e6a-4471-8108-ff30d8c80d24\") " pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:40.111725 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:40.111695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:40.117318 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:40.117291 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" event={"ID":"31704c16-fd54-4434-ab6e-2560ecce64e9","Type":"ContainerStarted","Data":"6c7d5ca29baac7b44abd1737a4b45e7c3313bc58a32ebe303dfa91b6e06d8535"} Jun 05 13:40:40.247701 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:40.247670 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gn22q"] Jun 05 13:40:40.250766 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:40:40.250741 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc1bcdb_2e6a_4471_8108_ff30d8c80d24.slice/crio-89fa9ab42607d1db6bdfffd0320fd4dcdafc5eac73fc89c6addad85742f38b54 WatchSource:0}: Error finding container 89fa9ab42607d1db6bdfffd0320fd4dcdafc5eac73fc89c6addad85742f38b54: Status 404 returned error can't find the container with id 89fa9ab42607d1db6bdfffd0320fd4dcdafc5eac73fc89c6addad85742f38b54 Jun 05 13:40:41.124321 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:41.124242 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" event={"ID":"ddc1bcdb-2e6a-4471-8108-ff30d8c80d24","Type":"ContainerStarted","Data":"89fa9ab42607d1db6bdfffd0320fd4dcdafc5eac73fc89c6addad85742f38b54"} Jun 05 13:40:43.133481 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.133438 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" event={"ID":"ddc1bcdb-2e6a-4471-8108-ff30d8c80d24","Type":"ContainerStarted","Data":"258f996e2bf5eca5dfd4953bd34c8a35a82cdcc1ded3a0a4fbd79d63e79dcb72"} Jun 05 13:40:43.134926 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.134895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" event={"ID":"31704c16-fd54-4434-ab6e-2560ecce64e9","Type":"ContainerStarted","Data":"48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f"} Jun 05 13:40:43.135065 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.134950 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" podUID="31704c16-fd54-4434-ab6e-2560ecce64e9" containerName="registry-server" containerID="cri-o://48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f" gracePeriod=2 Jun 05 13:40:43.150647 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.150604 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" podStartSLOduration=2.342356693 podStartE2EDuration="4.150589156s" totalImagesPullingTime="1.808232463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:40:43.149392417 +0000 UTC m=+982.093686786" watchObservedRunningTime="2026-06-05 13:40:43.150589156 +0000 UTC m=+982.094883465" Jun 05 13:40:43.165268 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.165218 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" podStartSLOduration=1.7783899920000001 podStartE2EDuration="4.165201848s" totalImagesPullingTime="2.386811856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:40:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:40:43.163583401 +0000 UTC m=+982.107877711" watchObservedRunningTime="2026-06-05 13:40:43.165201848 +0000 UTC m=+982.109496134" Jun 05 13:40:43.378911 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.378887 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:43.508626 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.508596 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwmqv\" (UniqueName: \"kubernetes.io/projected/31704c16-fd54-4434-ab6e-2560ecce64e9-kube-api-access-pwmqv\") pod \"31704c16-fd54-4434-ab6e-2560ecce64e9\" (UID: \"31704c16-fd54-4434-ab6e-2560ecce64e9\") " Jun 05 13:40:43.510716 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.510693 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31704c16-fd54-4434-ab6e-2560ecce64e9-kube-api-access-pwmqv" (OuterVolumeSpecName: "kube-api-access-pwmqv") pod "31704c16-fd54-4434-ab6e-2560ecce64e9" (UID: "31704c16-fd54-4434-ab6e-2560ecce64e9"). InnerVolumeSpecName "kube-api-access-pwmqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:40:43.609304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:43.609269 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwmqv\" (UniqueName: \"kubernetes.io/projected/31704c16-fd54-4434-ab6e-2560ecce64e9-kube-api-access-pwmqv\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:40:44.140728 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.140692 2565 generic.go:356] "Generic (PLEG): container finished" podID="31704c16-fd54-4434-ab6e-2560ecce64e9" containerID="48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f" exitCode=0 Jun 05 13:40:44.141141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.140751 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" Jun 05 13:40:44.141141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.140780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" event={"ID":"31704c16-fd54-4434-ab6e-2560ecce64e9","Type":"ContainerDied","Data":"48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f"} Jun 05 13:40:44.141141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.140854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gqwp2" event={"ID":"31704c16-fd54-4434-ab6e-2560ecce64e9","Type":"ContainerDied","Data":"6c7d5ca29baac7b44abd1737a4b45e7c3313bc58a32ebe303dfa91b6e06d8535"} Jun 05 13:40:44.141141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.140875 2565 scope.go:117] "RemoveContainer" containerID="48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f" Jun 05 13:40:44.150286 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.150269 2565 scope.go:117] "RemoveContainer" containerID="48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f" Jun 05 13:40:44.150560 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:40:44.150542 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f\": container with ID starting with 48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f not found: ID does not exist" containerID="48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f" Jun 05 13:40:44.150610 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.150568 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f"} err="failed to get container status \"48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f\": rpc error: code = NotFound desc = could not find container \"48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f\": container with ID starting with 48c0ad32464d55cf37b230d5aa6da73b8555dbe50acba571ab511462b1059c1f not found: ID does not exist" Jun 05 13:40:44.163677 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.163652 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwp2"] Jun 05 13:40:44.167806 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:44.167788 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gqwp2"] Jun 05 13:40:45.464235 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:45.464202 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31704c16-fd54-4434-ab6e-2560ecce64e9" path="/var/lib/kubelet/pods/31704c16-fd54-4434-ab6e-2560ecce64e9/volumes" Jun 05 13:40:50.112639 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:50.112605 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:50.113161 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:50.112680 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:50.134594 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:50.134568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:40:50.189838 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:40:50.189813 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gn22q" Jun 05 13:41:09.136101 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.136055 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj"] Jun 05 13:41:09.136487 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.136409 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31704c16-fd54-4434-ab6e-2560ecce64e9" containerName="registry-server" Jun 05 13:41:09.136487 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.136420 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31704c16-fd54-4434-ab6e-2560ecce64e9" containerName="registry-server" Jun 05 13:41:09.136487 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.136479 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31704c16-fd54-4434-ab6e-2560ecce64e9" containerName="registry-server" Jun 05 13:41:09.148403 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.148380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:09.152411 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.152388 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-c76x2\"" Jun 05 13:41:09.158032 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.158003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj"] Jun 05 13:41:09.221400 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.221364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfc69\" (UniqueName: \"kubernetes.io/projected/c38c34e5-277d-424c-b276-6d42cd577786-kube-api-access-mfc69\") pod \"authorino-operator-75cc8d5cb7-5r6sj\" (UID: \"c38c34e5-277d-424c-b276-6d42cd577786\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:09.321830 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.321799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfc69\" (UniqueName: \"kubernetes.io/projected/c38c34e5-277d-424c-b276-6d42cd577786-kube-api-access-mfc69\") pod \"authorino-operator-75cc8d5cb7-5r6sj\" (UID: \"c38c34e5-277d-424c-b276-6d42cd577786\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:09.334024 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.333992 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfc69\" (UniqueName: \"kubernetes.io/projected/c38c34e5-277d-424c-b276-6d42cd577786-kube-api-access-mfc69\") pod \"authorino-operator-75cc8d5cb7-5r6sj\" (UID: \"c38c34e5-277d-424c-b276-6d42cd577786\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:09.458685 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.458653 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:09.594526 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:09.594501 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj"] Jun 05 13:41:09.596430 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:41:09.596398 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38c34e5_277d_424c_b276_6d42cd577786.slice/crio-c9a994783da930fb9583c3e567c7a632a869efd879acfe6a2b8f3718a6cebf3d WatchSource:0}: Error finding container c9a994783da930fb9583c3e567c7a632a869efd879acfe6a2b8f3718a6cebf3d: Status 404 returned error can't find the container with id c9a994783da930fb9583c3e567c7a632a869efd879acfe6a2b8f3718a6cebf3d Jun 05 13:41:10.261281 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:10.261238 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" event={"ID":"c38c34e5-277d-424c-b276-6d42cd577786","Type":"ContainerStarted","Data":"c9a994783da930fb9583c3e567c7a632a869efd879acfe6a2b8f3718a6cebf3d"} Jun 05 13:41:12.273935 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.273899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" event={"ID":"c38c34e5-277d-424c-b276-6d42cd577786","Type":"ContainerStarted","Data":"e4d2488dbcc95d20f705a0abcbb44cd486617cdc62170d235df039ba11653de1"} Jun 05 13:41:12.274332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.273966 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:12.290970 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.290925 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" podStartSLOduration=1.106366235 podStartE2EDuration="3.290911861s" totalImagesPullingTime="2.184545626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:41:12.290373798 +0000 UTC m=+1011.234668106" watchObservedRunningTime="2026-06-05 13:41:12.290911861 +0000 UTC m=+1011.235206171" Jun 05 13:41:12.354866 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.354835 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd"] Jun 05 13:41:12.358174 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.358154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:12.360691 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.360674 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 13:41:12.360870 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.360857 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kc8kh\"" Jun 05 13:41:12.372727 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.372705 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd"] Jun 05 13:41:12.459247 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.459210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xp5g\" (UniqueName: \"kubernetes.io/projected/71d642d5-20de-4314-9863-877398ce292a-kube-api-access-9xp5g\") pod \"dns-operator-controller-manager-864dd78c4c-vgfjd\" (UID: \"71d642d5-20de-4314-9863-877398ce292a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:12.560548 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.560457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xp5g\" (UniqueName: \"kubernetes.io/projected/71d642d5-20de-4314-9863-877398ce292a-kube-api-access-9xp5g\") pod \"dns-operator-controller-manager-864dd78c4c-vgfjd\" (UID: \"71d642d5-20de-4314-9863-877398ce292a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:12.578483 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.578450 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xp5g\" (UniqueName: \"kubernetes.io/projected/71d642d5-20de-4314-9863-877398ce292a-kube-api-access-9xp5g\") pod \"dns-operator-controller-manager-864dd78c4c-vgfjd\" (UID: \"71d642d5-20de-4314-9863-877398ce292a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:12.667593 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.667559 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:12.808112 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:12.808085 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd"] Jun 05 13:41:12.810722 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:41:12.810659 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d642d5_20de_4314_9863_877398ce292a.slice/crio-b76cbe6f9ba8bf2062cef8853e572c1b5e339b110e4ba51d608a3d2decd4500b WatchSource:0}: Error finding container b76cbe6f9ba8bf2062cef8853e572c1b5e339b110e4ba51d608a3d2decd4500b: Status 404 returned error can't find the container with id b76cbe6f9ba8bf2062cef8853e572c1b5e339b110e4ba51d608a3d2decd4500b Jun 05 13:41:13.280211 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:13.280174 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" event={"ID":"71d642d5-20de-4314-9863-877398ce292a","Type":"ContainerStarted","Data":"b76cbe6f9ba8bf2062cef8853e572c1b5e339b110e4ba51d608a3d2decd4500b"} Jun 05 13:41:15.295929 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.295893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" event={"ID":"71d642d5-20de-4314-9863-877398ce292a","Type":"ContainerStarted","Data":"67bea9d37b791150e14405215a4116ad08e9b99431b325515dd46405e5d423aa"} Jun 05 13:41:15.296302 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.295996 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:15.313063 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.312950 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" podStartSLOduration=1.0267808920000001 podStartE2EDuration="3.312932669s" totalImagesPullingTime="2.286151777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:41:15.312100653 +0000 UTC m=+1014.256394962" watchObservedRunningTime="2026-06-05 13:41:15.312932669 +0000 UTC m=+1014.257226990" Jun 05 13:41:15.896947 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.896921 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v"] Jun 05 13:41:15.901179 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.901159 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:15.904285 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.904265 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2cvvm\"" Jun 05 13:41:15.913546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.913522 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v"] Jun 05 13:41:15.995397 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:15.995359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvrnz\" (UniqueName: \"kubernetes.io/projected/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d-kube-api-access-nvrnz\") pod \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" (UID: \"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:16.096699 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:16.096671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvrnz\" (UniqueName: \"kubernetes.io/projected/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d-kube-api-access-nvrnz\") pod \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" (UID: \"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:16.108163 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:16.108139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvrnz\" (UniqueName: \"kubernetes.io/projected/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d-kube-api-access-nvrnz\") pod \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" (UID: \"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:16.210974 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:16.210933 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:16.341615 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:16.341592 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v"] Jun 05 13:41:16.343326 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:41:16.343285 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef2132d_c8eb_476a_aaa1_b72d4c7fc29d.slice/crio-bdd8a6d0f0d033164911c987abc688446d9c38af1400f4b99825f74ef80a3936 WatchSource:0}: Error finding container bdd8a6d0f0d033164911c987abc688446d9c38af1400f4b99825f74ef80a3936: Status 404 returned error can't find the container with id bdd8a6d0f0d033164911c987abc688446d9c38af1400f4b99825f74ef80a3936 Jun 05 13:41:17.307010 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:17.306972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" event={"ID":"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d","Type":"ContainerStarted","Data":"bdd8a6d0f0d033164911c987abc688446d9c38af1400f4b99825f74ef80a3936"} Jun 05 13:41:19.318737 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:19.318700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" event={"ID":"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d","Type":"ContainerStarted","Data":"bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0"} Jun 05 13:41:19.319162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:19.318816 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:19.337133 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:19.337071 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" podStartSLOduration=2.2726681810000002 podStartE2EDuration="4.337025103s" totalImagesPullingTime="2.064356922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:41:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:41:19.335174297 +0000 UTC m=+1018.279468606" watchObservedRunningTime="2026-06-05 13:41:19.337025103 +0000 UTC m=+1018.281319411" Jun 05 13:41:23.283325 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:23.283285 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-5r6sj" Jun 05 13:41:26.303333 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:26.303302 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vgfjd" Jun 05 13:41:30.325622 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:30.325584 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:39.208381 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.208348 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4"] Jun 05 13:41:39.213166 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.213149 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.216231 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.216201 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xxnsc\"" Jun 05 13:41:39.225557 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.225535 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4"] Jun 05 13:41:39.308670 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.308638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31228ab7-d561-47e8-9077-96febc6feb28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.308867 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.308714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g59j\" (UniqueName: \"kubernetes.io/projected/31228ab7-d561-47e8-9077-96febc6feb28-kube-api-access-9g59j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.409570 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.409526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31228ab7-d561-47e8-9077-96febc6feb28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.409772 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.409605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g59j\" (UniqueName: \"kubernetes.io/projected/31228ab7-d561-47e8-9077-96febc6feb28-kube-api-access-9g59j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.409931 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.409910 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31228ab7-d561-47e8-9077-96febc6feb28-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.418352 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.418325 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g59j\" (UniqueName: \"kubernetes.io/projected/31228ab7-d561-47e8-9077-96febc6feb28-kube-api-access-9g59j\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.523172 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.523075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:39.671367 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.671026 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4"] Jun 05 13:41:39.673543 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:41:39.673510 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31228ab7_d561_47e8_9077_96febc6feb28.slice/crio-e4e8153fb01b15139077f4d155699dc10b07ab04197093cf66e4fbc6fa794172 WatchSource:0}: Error finding container e4e8153fb01b15139077f4d155699dc10b07ab04197093cf66e4fbc6fa794172: Status 404 returned error can't find the container with id e4e8153fb01b15139077f4d155699dc10b07ab04197093cf66e4fbc6fa794172 Jun 05 13:41:39.959662 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.959627 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4"] Jun 05 13:41:39.964573 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:39.964538 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4"] Jun 05 13:41:40.000406 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.000371 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v"] Jun 05 13:41:40.000849 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.000746 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" containerName="manager" containerID="cri-o://bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0" gracePeriod=2 Jun 05 13:41:40.003256 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.003235 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc"] Jun 05 13:41:40.008264 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.008242 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.013730 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.013705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vs74\" (UniqueName: \"kubernetes.io/projected/942735cd-2e82-474b-b633-d6b74545b6fe-kube-api-access-9vs74\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6zc\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.013830 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.013752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942735cd-2e82-474b-b633-d6b74545b6fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6zc\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.013830 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.013774 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v"] Jun 05 13:41:40.025564 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.025489 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-4nb4v\": pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.029003 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.028981 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc"] Jun 05 13:41:40.031214 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.031192 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb"] Jun 05 13:41:40.031546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.031533 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" containerName="manager" Jun 05 13:41:40.031546 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.031546 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" containerName="manager" Jun 05 13:41:40.031678 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.031610 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" containerName="manager" Jun 05 13:41:40.034448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.034429 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:40.046262 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.046230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb"] Jun 05 13:41:40.054501 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.054468 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.056654 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.056619 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.114471 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.114439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnpzf\" (UniqueName: \"kubernetes.io/projected/2f2f1119-6607-413f-aa05-f338d347a848-kube-api-access-qnpzf\") pod \"limitador-operator-controller-manager-859d7b78bd-58btb\" (UID: \"2f2f1119-6607-413f-aa05-f338d347a848\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:40.114582 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.114555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vs74\" (UniqueName: \"kubernetes.io/projected/942735cd-2e82-474b-b633-d6b74545b6fe-kube-api-access-9vs74\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6zc\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.114623 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.114601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942735cd-2e82-474b-b633-d6b74545b6fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6zc\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.115167 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.115138 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942735cd-2e82-474b-b633-d6b74545b6fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6zc\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.124686 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.124661 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vs74\" (UniqueName: \"kubernetes.io/projected/942735cd-2e82-474b-b633-d6b74545b6fe-kube-api-access-9vs74\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gd6zc\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.215585 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.215495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnpzf\" (UniqueName: \"kubernetes.io/projected/2f2f1119-6607-413f-aa05-f338d347a848-kube-api-access-qnpzf\") pod \"limitador-operator-controller-manager-859d7b78bd-58btb\" (UID: \"2f2f1119-6607-413f-aa05-f338d347a848\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:40.227917 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.227888 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnpzf\" (UniqueName: \"kubernetes.io/projected/2f2f1119-6607-413f-aa05-f338d347a848-kube-api-access-qnpzf\") pod \"limitador-operator-controller-manager-859d7b78bd-58btb\" (UID: \"2f2f1119-6607-413f-aa05-f338d347a848\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:40.235162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.235140 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.237400 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.237358 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.316197 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.316166 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvrnz\" (UniqueName: \"kubernetes.io/projected/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d-kube-api-access-nvrnz\") pod \"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d\" (UID: \"eef2132d-c8eb-476a-aaa1-b72d4c7fc29d\") " Jun 05 13:41:40.318807 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.318775 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d-kube-api-access-nvrnz" (OuterVolumeSpecName: "kube-api-access-nvrnz") pod "eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" (UID: "eef2132d-c8eb-476a-aaa1-b72d4c7fc29d"). InnerVolumeSpecName "kube-api-access-nvrnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:41:40.382404 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.382360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:40.388218 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.388193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:40.417705 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.417672 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvrnz\" (UniqueName: \"kubernetes.io/projected/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d-kube-api-access-nvrnz\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:41:40.435189 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.435157 2565 generic.go:356] "Generic (PLEG): container finished" podID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" containerID="bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0" exitCode=0 Jun 05 13:41:40.435803 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.435784 2565 scope.go:117] "RemoveContainer" containerID="bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0" Jun 05 13:41:40.436428 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.436413 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.440702 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.440666 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.454409 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.454374 2565 scope.go:117] "RemoveContainer" containerID="bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0" Jun 05 13:41:40.455066 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.455011 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0\": container with ID starting with bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0 not found: ID does not exist" containerID="bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0" Jun 05 13:41:40.455176 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.455079 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0"} err="failed to get container status \"bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0\": rpc error: code = NotFound desc = could not find container \"bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0\": container with ID starting with bd0087f3985ba28f9f5f110da9fcc6a57b3513d739a7f860ab1ee172f39d42d0 not found: ID does not exist" Jun 05 13:41:40.456980 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:40.456946 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:40.559320 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.557007 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb"] Jun 05 13:41:40.560901 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:41:40.560859 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2f1119_6607_413f_aa05_f338d347a848.slice/crio-11066e5b4cacaa049f0a3d27114d95a4b0d87ef59e3a748708232a58a0df3255 WatchSource:0}: Error finding container 11066e5b4cacaa049f0a3d27114d95a4b0d87ef59e3a748708232a58a0df3255: Status 404 returned error can't find the container with id 11066e5b4cacaa049f0a3d27114d95a4b0d87ef59e3a748708232a58a0df3255 Jun 05 13:41:40.579454 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:40.579427 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc"] Jun 05 13:41:40.582935 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:41:40.582900 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942735cd_2e82_474b_b633_d6b74545b6fe.slice/crio-b9a4e45167807e6812e187ab6ffa7bf882170b47a2634e9a6643d9f2a4ecebfe WatchSource:0}: Error finding container b9a4e45167807e6812e187ab6ffa7bf882170b47a2634e9a6643d9f2a4ecebfe: Status 404 returned error can't find the container with id b9a4e45167807e6812e187ab6ffa7bf882170b47a2634e9a6643d9f2a4ecebfe Jun 05 13:41:41.453596 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:41.453549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" event={"ID":"942735cd-2e82-474b-b633-d6b74545b6fe","Type":"ContainerStarted","Data":"b9a4e45167807e6812e187ab6ffa7bf882170b47a2634e9a6643d9f2a4ecebfe"} Jun 05 13:41:41.455600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:41.455383 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" event={"ID":"2f2f1119-6607-413f-aa05-f338d347a848","Type":"ContainerStarted","Data":"75fddc46109d2b65202b7aaa5f64ce4615fdb12459779101e1af53ee5562fe87"} Jun 05 13:41:41.455600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:41.455431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" event={"ID":"2f2f1119-6607-413f-aa05-f338d347a848","Type":"ContainerStarted","Data":"11066e5b4cacaa049f0a3d27114d95a4b0d87ef59e3a748708232a58a0df3255"} Jun 05 13:41:41.455600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:41.455536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:41.459098 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:41.459064 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4nb4v\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4nb4v" Jun 05 13:41:41.467144 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:41.467088 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef2132d-c8eb-476a-aaa1-b72d4c7fc29d" path="/var/lib/kubelet/pods/eef2132d-c8eb-476a-aaa1-b72d4c7fc29d/volumes" Jun 05 13:41:41.490924 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:41.490864 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" podStartSLOduration=1.490843223 podStartE2EDuration="1.490843223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:41:41.489909015 +0000 UTC m=+1040.434203325" watchObservedRunningTime="2026-06-05 13:41:41.490843223 +0000 UTC m=+1040.435137531" Jun 05 13:41:43.468954 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:43.468916 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" podUID="31228ab7-d561-47e8-9077-96febc6feb28" containerName="manager" containerID="cri-o://55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0" gracePeriod=2 Jun 05 13:41:43.470652 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:43.470626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" event={"ID":"942735cd-2e82-474b-b633-d6b74545b6fe","Type":"ContainerStarted","Data":"0689d7005a1be23c767f78298604571e4dd7b6aab9d1f5b9903379f3fca23893"} Jun 05 13:41:43.470761 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:43.470676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:43.471989 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:43.471967 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="31228ab7-d561-47e8-9077-96febc6feb28" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:43.500931 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:43.500888 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="31228ab7-d561-47e8-9077-96febc6feb28" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:43.501486 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:43.501446 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" podStartSLOduration=1.720815 podStartE2EDuration="4.501431132s" totalImagesPullingTime="2.780616132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:41:43.497929756 +0000 UTC m=+1042.442224086" watchObservedRunningTime="2026-06-05 13:41:43.501431132 +0000 UTC m=+1042.445725494" Jun 05 13:41:45.651497 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.651472 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:45.653997 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:45.653966 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="31228ab7-d561-47e8-9077-96febc6feb28" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:45.772595 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.772508 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31228ab7-d561-47e8-9077-96febc6feb28-extensions-socket-volume\") pod \"31228ab7-d561-47e8-9077-96febc6feb28\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " Jun 05 13:41:45.772756 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.772674 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g59j\" (UniqueName: \"kubernetes.io/projected/31228ab7-d561-47e8-9077-96febc6feb28-kube-api-access-9g59j\") pod \"31228ab7-d561-47e8-9077-96febc6feb28\" (UID: \"31228ab7-d561-47e8-9077-96febc6feb28\") " Jun 05 13:41:45.772835 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.772772 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31228ab7-d561-47e8-9077-96febc6feb28-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "31228ab7-d561-47e8-9077-96febc6feb28" (UID: "31228ab7-d561-47e8-9077-96febc6feb28"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:41:45.772908 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.772893 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/31228ab7-d561-47e8-9077-96febc6feb28-extensions-socket-volume\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:41:45.774683 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.774653 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31228ab7-d561-47e8-9077-96febc6feb28-kube-api-access-9g59j" (OuterVolumeSpecName: "kube-api-access-9g59j") pod "31228ab7-d561-47e8-9077-96febc6feb28" (UID: "31228ab7-d561-47e8-9077-96febc6feb28"). InnerVolumeSpecName "kube-api-access-9g59j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:41:45.874191 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:45.874142 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g59j\" (UniqueName: \"kubernetes.io/projected/31228ab7-d561-47e8-9077-96febc6feb28-kube-api-access-9g59j\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:41:46.488490 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:46.488454 2565 generic.go:356] "Generic (PLEG): container finished" podID="31228ab7-d561-47e8-9077-96febc6feb28" containerID="55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0" exitCode=137 Jun 05 13:41:46.488665 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:46.488512 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:46.488665 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:46.488566 2565 scope.go:117] "RemoveContainer" containerID="55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0" Jun 05 13:41:46.491252 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:46.491218 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="31228ab7-d561-47e8-9077-96febc6feb28" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:46.497536 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:46.497520 2565 scope.go:117] "RemoveContainer" containerID="55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0" Jun 05 13:41:46.497793 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:46.497778 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0\": container with ID starting with 55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0 not found: ID does not exist" containerID="55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0" Jun 05 13:41:46.497832 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:46.497801 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0"} err="failed to get container status \"55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0\": rpc error: code = NotFound desc = could not find container \"55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0\": container with ID starting with 55ae2717286a901fe072a02efce0644bc507c37af6c0b2506b0a6d5cb128cba0 not found: ID does not exist" Jun 05 13:41:46.499292 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:41:46.499270 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-sk4n4\" is forbidden: User \"system:node:ip-10-0-142-213.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-213.ec2.internal' and this object" podUID="31228ab7-d561-47e8-9077-96febc6feb28" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-sk4n4" Jun 05 13:41:47.465104 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:47.465068 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31228ab7-d561-47e8-9077-96febc6feb28" path="/var/lib/kubelet/pods/31228ab7-d561-47e8-9077-96febc6feb28/volumes" Jun 05 13:41:52.368376 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.368337 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc"] Jun 05 13:41:52.368895 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.368532 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" podUID="942735cd-2e82-474b-b633-d6b74545b6fe" containerName="manager" containerID="cri-o://0689d7005a1be23c767f78298604571e4dd7b6aab9d1f5b9903379f3fca23893" gracePeriod=10 Jun 05 13:41:52.370398 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.370370 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:52.464955 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.464924 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-58btb" Jun 05 13:41:52.520946 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.520914 2565 generic.go:356] "Generic (PLEG): container finished" podID="942735cd-2e82-474b-b633-d6b74545b6fe" containerID="0689d7005a1be23c767f78298604571e4dd7b6aab9d1f5b9903379f3fca23893" exitCode=0 Jun 05 13:41:52.521139 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.520989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" event={"ID":"942735cd-2e82-474b-b633-d6b74545b6fe","Type":"ContainerDied","Data":"0689d7005a1be23c767f78298604571e4dd7b6aab9d1f5b9903379f3fca23893"} Jun 05 13:41:52.621983 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.621923 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:52.740402 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.740372 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vs74\" (UniqueName: \"kubernetes.io/projected/942735cd-2e82-474b-b633-d6b74545b6fe-kube-api-access-9vs74\") pod \"942735cd-2e82-474b-b633-d6b74545b6fe\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " Jun 05 13:41:52.740579 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.740429 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942735cd-2e82-474b-b633-d6b74545b6fe-extensions-socket-volume\") pod \"942735cd-2e82-474b-b633-d6b74545b6fe\" (UID: \"942735cd-2e82-474b-b633-d6b74545b6fe\") " Jun 05 13:41:52.740961 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.740924 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/942735cd-2e82-474b-b633-d6b74545b6fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "942735cd-2e82-474b-b633-d6b74545b6fe" (UID: "942735cd-2e82-474b-b633-d6b74545b6fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 13:41:52.742497 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.742476 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942735cd-2e82-474b-b633-d6b74545b6fe-kube-api-access-9vs74" (OuterVolumeSpecName: "kube-api-access-9vs74") pod "942735cd-2e82-474b-b633-d6b74545b6fe" (UID: "942735cd-2e82-474b-b633-d6b74545b6fe"). InnerVolumeSpecName "kube-api-access-9vs74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:41:52.841285 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.841254 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vs74\" (UniqueName: \"kubernetes.io/projected/942735cd-2e82-474b-b633-d6b74545b6fe-kube-api-access-9vs74\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:41:52.841285 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:52.841281 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942735cd-2e82-474b-b633-d6b74545b6fe-extensions-socket-volume\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:41:53.526849 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:53.526819 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" Jun 05 13:41:53.527346 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:53.526851 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc" event={"ID":"942735cd-2e82-474b-b633-d6b74545b6fe","Type":"ContainerDied","Data":"b9a4e45167807e6812e187ab6ffa7bf882170b47a2634e9a6643d9f2a4ecebfe"} Jun 05 13:41:53.527346 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:53.526903 2565 scope.go:117] "RemoveContainer" containerID="0689d7005a1be23c767f78298604571e4dd7b6aab9d1f5b9903379f3fca23893" Jun 05 13:41:53.549274 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:53.549240 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc"] Jun 05 13:41:53.551644 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:53.551621 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gd6zc"] Jun 05 13:41:55.464584 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:41:55.464544 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="942735cd-2e82-474b-b633-d6b74545b6fe" path="/var/lib/kubelet/pods/942735cd-2e82-474b-b633-d6b74545b6fe/volumes" Jun 05 13:42:08.607905 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.607862 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz"] Jun 05 13:42:08.608878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.608851 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="942735cd-2e82-474b-b633-d6b74545b6fe" containerName="manager" Jun 05 13:42:08.608878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.608875 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="942735cd-2e82-474b-b633-d6b74545b6fe" containerName="manager" Jun 05 13:42:08.609117 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.608901 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31228ab7-d561-47e8-9077-96febc6feb28" containerName="manager" Jun 05 13:42:08.609117 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.608907 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31228ab7-d561-47e8-9077-96febc6feb28" containerName="manager" Jun 05 13:42:08.609117 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.608993 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31228ab7-d561-47e8-9077-96febc6feb28" containerName="manager" Jun 05 13:42:08.609117 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.609006 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="942735cd-2e82-474b-b633-d6b74545b6fe" containerName="manager" Jun 05 13:42:08.612184 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.612163 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.614878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.614852 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4x49x\"" Jun 05 13:42:08.623363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.623339 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz"] Jun 05 13:42:08.791178 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791388 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791388 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161b9951-a0f4-40d2-bb77-c162bc4be92b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791388 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791578 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791578 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791465 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791578 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsjnf\" (UniqueName: \"kubernetes.io/projected/161b9951-a0f4-40d2-bb77-c162bc4be92b-kube-api-access-hsjnf\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791578 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791523 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.791764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.791623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.892824 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.892728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.892824 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.892773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.892824 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.892799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsjnf\" (UniqueName: \"kubernetes.io/projected/161b9951-a0f4-40d2-bb77-c162bc4be92b-kube-api-access-hsjnf\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.892826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.892895 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893160 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893200 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893259 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161b9951-a0f4-40d2-bb77-c162bc4be92b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893259 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893349 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893257 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893349 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893288 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893455 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893434 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893519 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.893874 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.893851 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/161b9951-a0f4-40d2-bb77-c162bc4be92b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.895502 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.895478 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.895682 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.895664 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.900499 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.900477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsjnf\" (UniqueName: \"kubernetes.io/projected/161b9951-a0f4-40d2-bb77-c162bc4be92b-kube-api-access-hsjnf\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.900610 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.900543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/161b9951-a0f4-40d2-bb77-c162bc4be92b-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-v5kvz\" (UID: \"161b9951-a0f4-40d2-bb77-c162bc4be92b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:08.924820 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:08.924789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:09.061217 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.061186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz"] Jun 05 13:42:09.062624 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:42:09.062597 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161b9951_a0f4_40d2_bb77_c162bc4be92b.slice/crio-42899465f8f9c64bd7b8047dc56eda88d73f4a27ecf8ef9cb7340da13b28368b WatchSource:0}: Error finding container 42899465f8f9c64bd7b8047dc56eda88d73f4a27ecf8ef9cb7340da13b28368b: Status 404 returned error can't find the container with id 42899465f8f9c64bd7b8047dc56eda88d73f4a27ecf8ef9cb7340da13b28368b Jun 05 13:42:09.064802 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.064757 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:42:09.064908 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.064853 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:42:09.064908 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.064899 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:42:09.607359 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.607322 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" event={"ID":"161b9951-a0f4-40d2-bb77-c162bc4be92b","Type":"ContainerStarted","Data":"f5d31f7a40159526775336a774ae86d79a46a544123f4e4be7b70582a055ed44"} Jun 05 13:42:09.607608 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.607371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" event={"ID":"161b9951-a0f4-40d2-bb77-c162bc4be92b","Type":"ContainerStarted","Data":"42899465f8f9c64bd7b8047dc56eda88d73f4a27ecf8ef9cb7340da13b28368b"} Jun 05 13:42:09.628899 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.628847 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" podStartSLOduration=1.628830923 podStartE2EDuration="1.628830923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:42:09.626589379 +0000 UTC m=+1068.570883689" watchObservedRunningTime="2026-06-05 13:42:09.628830923 +0000 UTC m=+1068.573125232" Jun 05 13:42:09.925819 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:09.925736 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:10.930459 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:10.930423 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:11.617641 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:11.617611 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:11.618717 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:11.618700 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:42:22.093283 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.093251 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:22.096363 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.096343 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.098790 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.098767 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 05 13:42:22.098894 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.098827 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qmcbm\"" Jun 05 13:42:22.104591 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.104571 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:22.115600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.115576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd830def-6bb6-4c2c-b38a-af85e3172211-config-file\") pod \"limitador-limitador-64c94fd64f-hvbrg\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.115723 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.115703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcgd\" (UniqueName: \"kubernetes.io/projected/fd830def-6bb6-4c2c-b38a-af85e3172211-kube-api-access-txcgd\") pod \"limitador-limitador-64c94fd64f-hvbrg\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.191827 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.191790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:22.217164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.217130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcgd\" (UniqueName: \"kubernetes.io/projected/fd830def-6bb6-4c2c-b38a-af85e3172211-kube-api-access-txcgd\") pod \"limitador-limitador-64c94fd64f-hvbrg\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.217327 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.217191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd830def-6bb6-4c2c-b38a-af85e3172211-config-file\") pod \"limitador-limitador-64c94fd64f-hvbrg\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.217846 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.217828 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd830def-6bb6-4c2c-b38a-af85e3172211-config-file\") pod \"limitador-limitador-64c94fd64f-hvbrg\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.224536 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.224513 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcgd\" (UniqueName: \"kubernetes.io/projected/fd830def-6bb6-4c2c-b38a-af85e3172211-kube-api-access-txcgd\") pod \"limitador-limitador-64c94fd64f-hvbrg\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.407484 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.407396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:22.568960 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.568933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:22.570604 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:42:22.570577 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd830def_6bb6_4c2c_b38a_af85e3172211.slice/crio-046ff7605f00fb9e3432ef7e56885f3c9d9038cdb292699b6f8b6849c354b038 WatchSource:0}: Error finding container 046ff7605f00fb9e3432ef7e56885f3c9d9038cdb292699b6f8b6849c354b038: Status 404 returned error can't find the container with id 046ff7605f00fb9e3432ef7e56885f3c9d9038cdb292699b6f8b6849c354b038 Jun 05 13:42:22.674705 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:22.674623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" event={"ID":"fd830def-6bb6-4c2c-b38a-af85e3172211","Type":"ContainerStarted","Data":"046ff7605f00fb9e3432ef7e56885f3c9d9038cdb292699b6f8b6849c354b038"} Jun 05 13:42:25.693715 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:25.693681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" event={"ID":"fd830def-6bb6-4c2c-b38a-af85e3172211","Type":"ContainerStarted","Data":"dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075"} Jun 05 13:42:25.694098 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:25.693743 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:25.711216 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:25.711170 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" podStartSLOduration=0.687505897 podStartE2EDuration="3.711155783s" totalImagesPullingTime="3.023649886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:42:25.710740908 +0000 UTC m=+1084.655035218" watchObservedRunningTime="2026-06-05 13:42:25.711155783 +0000 UTC m=+1084.655450092" Jun 05 13:42:36.700230 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:36.700195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:39.741304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:39.741266 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:39.741787 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:39.741493 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" podUID="fd830def-6bb6-4c2c-b38a-af85e3172211" containerName="limitador" containerID="cri-o://dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075" gracePeriod=30 Jun 05 13:42:40.292019 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.291993 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:40.392601 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.392510 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txcgd\" (UniqueName: \"kubernetes.io/projected/fd830def-6bb6-4c2c-b38a-af85e3172211-kube-api-access-txcgd\") pod \"fd830def-6bb6-4c2c-b38a-af85e3172211\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " Jun 05 13:42:40.392601 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.392552 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd830def-6bb6-4c2c-b38a-af85e3172211-config-file\") pod \"fd830def-6bb6-4c2c-b38a-af85e3172211\" (UID: \"fd830def-6bb6-4c2c-b38a-af85e3172211\") " Jun 05 13:42:40.392969 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.392945 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd830def-6bb6-4c2c-b38a-af85e3172211-config-file" (OuterVolumeSpecName: "config-file") pod "fd830def-6bb6-4c2c-b38a-af85e3172211" (UID: "fd830def-6bb6-4c2c-b38a-af85e3172211"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 13:42:40.394685 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.394658 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd830def-6bb6-4c2c-b38a-af85e3172211-kube-api-access-txcgd" (OuterVolumeSpecName: "kube-api-access-txcgd") pod "fd830def-6bb6-4c2c-b38a-af85e3172211" (UID: "fd830def-6bb6-4c2c-b38a-af85e3172211"). InnerVolumeSpecName "kube-api-access-txcgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:42:40.493696 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.493661 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txcgd\" (UniqueName: \"kubernetes.io/projected/fd830def-6bb6-4c2c-b38a-af85e3172211-kube-api-access-txcgd\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:42:40.493696 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.493691 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fd830def-6bb6-4c2c-b38a-af85e3172211-config-file\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:42:40.767752 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.767714 2565 generic.go:356] "Generic (PLEG): container finished" podID="fd830def-6bb6-4c2c-b38a-af85e3172211" containerID="dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075" exitCode=0 Jun 05 13:42:40.768215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.767765 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" Jun 05 13:42:40.768215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.767770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" event={"ID":"fd830def-6bb6-4c2c-b38a-af85e3172211","Type":"ContainerDied","Data":"dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075"} Jun 05 13:42:40.768215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.767821 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hvbrg" event={"ID":"fd830def-6bb6-4c2c-b38a-af85e3172211","Type":"ContainerDied","Data":"046ff7605f00fb9e3432ef7e56885f3c9d9038cdb292699b6f8b6849c354b038"} Jun 05 13:42:40.768215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.767851 2565 scope.go:117] "RemoveContainer" containerID="dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075" Jun 05 13:42:40.776258 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.776177 2565 scope.go:117] "RemoveContainer" containerID="dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075" Jun 05 13:42:40.776467 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:42:40.776447 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075\": container with ID starting with dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075 not found: ID does not exist" containerID="dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075" Jun 05 13:42:40.776519 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.776475 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075"} err="failed to get container status \"dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075\": rpc error: code = NotFound desc = could not find container \"dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075\": container with ID starting with dd7e429be8d2f6c3a4391f8b24fa135481d31c2092e855f27eb18e3beb9e8075 not found: ID does not exist" Jun 05 13:42:40.788827 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.788804 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:40.792544 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:40.792520 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hvbrg"] Jun 05 13:42:41.463859 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:41.463827 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd830def-6bb6-4c2c-b38a-af85e3172211" path="/var/lib/kubelet/pods/fd830def-6bb6-4c2c-b38a-af85e3172211/volumes" Jun 05 13:42:44.017317 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.017281 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-zbk2q"] Jun 05 13:42:44.017711 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.017698 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd830def-6bb6-4c2c-b38a-af85e3172211" containerName="limitador" Jun 05 13:42:44.017756 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.017713 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd830def-6bb6-4c2c-b38a-af85e3172211" containerName="limitador" Jun 05 13:42:44.017792 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.017778 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd830def-6bb6-4c2c-b38a-af85e3172211" containerName="limitador" Jun 05 13:42:44.020687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.020668 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.023307 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.023274 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 05 13:42:44.028658 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.028630 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-zbk2q"] Jun 05 13:42:44.131451 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.131412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5164cb5-2ff5-4008-8e42-12cc6f9e3699-data\") pod \"postgres-69fb4594cf-zbk2q\" (UID: \"c5164cb5-2ff5-4008-8e42-12cc6f9e3699\") " pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.131653 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.131480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cx7l\" (UniqueName: \"kubernetes.io/projected/c5164cb5-2ff5-4008-8e42-12cc6f9e3699-kube-api-access-2cx7l\") pod \"postgres-69fb4594cf-zbk2q\" (UID: \"c5164cb5-2ff5-4008-8e42-12cc6f9e3699\") " pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.232479 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.232440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5164cb5-2ff5-4008-8e42-12cc6f9e3699-data\") pod \"postgres-69fb4594cf-zbk2q\" (UID: \"c5164cb5-2ff5-4008-8e42-12cc6f9e3699\") " pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.232653 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.232488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cx7l\" (UniqueName: \"kubernetes.io/projected/c5164cb5-2ff5-4008-8e42-12cc6f9e3699-kube-api-access-2cx7l\") pod \"postgres-69fb4594cf-zbk2q\" (UID: \"c5164cb5-2ff5-4008-8e42-12cc6f9e3699\") " pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.232904 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.232881 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c5164cb5-2ff5-4008-8e42-12cc6f9e3699-data\") pod \"postgres-69fb4594cf-zbk2q\" (UID: \"c5164cb5-2ff5-4008-8e42-12cc6f9e3699\") " pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.241466 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.241438 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cx7l\" (UniqueName: \"kubernetes.io/projected/c5164cb5-2ff5-4008-8e42-12cc6f9e3699-kube-api-access-2cx7l\") pod \"postgres-69fb4594cf-zbk2q\" (UID: \"c5164cb5-2ff5-4008-8e42-12cc6f9e3699\") " pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.333739 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.333640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:44.465293 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.465269 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-zbk2q"] Jun 05 13:42:44.467346 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:42:44.467319 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5164cb5_2ff5_4008_8e42_12cc6f9e3699.slice/crio-21fcfd8512eee701ba46b4692043ab1ed564383591fb24c6f2f85f8b634e60a5 WatchSource:0}: Error finding container 21fcfd8512eee701ba46b4692043ab1ed564383591fb24c6f2f85f8b634e60a5: Status 404 returned error can't find the container with id 21fcfd8512eee701ba46b4692043ab1ed564383591fb24c6f2f85f8b634e60a5 Jun 05 13:42:44.787270 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:44.787233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-zbk2q" event={"ID":"c5164cb5-2ff5-4008-8e42-12cc6f9e3699","Type":"ContainerStarted","Data":"21fcfd8512eee701ba46b4692043ab1ed564383591fb24c6f2f85f8b634e60a5"} Jun 05 13:42:46.805291 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:46.805249 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-zbk2q" event={"ID":"c5164cb5-2ff5-4008-8e42-12cc6f9e3699","Type":"ContainerStarted","Data":"869a09b934727705f8707b35599e920e80dc9a01d8250f8c2d337416dfbfb403"} Jun 05 13:42:46.805681 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:46.805360 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:42:46.821521 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:46.821475 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-zbk2q" podStartSLOduration=0.660883803 podStartE2EDuration="2.821461627s" totalImagesPullingTime="2.160577824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:42:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:42:46.819803163 +0000 UTC m=+1105.764097475" watchObservedRunningTime="2026-06-05 13:42:46.821461627 +0000 UTC m=+1105.765755935" Jun 05 13:42:52.843245 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:42:52.843217 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-zbk2q" Jun 05 13:43:17.199427 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.199396 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:43:17.202767 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.202750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:17.205515 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.205487 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 13:43:17.205657 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.205494 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-g5q65\"" Jun 05 13:43:17.205657 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.205551 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 13:43:17.206421 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.206403 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 13:43:17.212005 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.211978 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:43:17.342773 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.342734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmx6v\" (UniqueName: \"kubernetes.io/projected/516bc8ff-dc38-4f3b-bef4-3c997df9be83-kube-api-access-fmx6v\") pod \"maas-keycloak-0\" (UID: \"516bc8ff-dc38-4f3b-bef4-3c997df9be83\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:17.443730 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.443690 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmx6v\" (UniqueName: \"kubernetes.io/projected/516bc8ff-dc38-4f3b-bef4-3c997df9be83-kube-api-access-fmx6v\") pod \"maas-keycloak-0\" (UID: \"516bc8ff-dc38-4f3b-bef4-3c997df9be83\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:17.453072 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.453005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmx6v\" (UniqueName: \"kubernetes.io/projected/516bc8ff-dc38-4f3b-bef4-3c997df9be83-kube-api-access-fmx6v\") pod \"maas-keycloak-0\" (UID: \"516bc8ff-dc38-4f3b-bef4-3c997df9be83\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:17.513610 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.513580 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:17.650834 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.650707 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:43:17.653719 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:43:17.653685 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516bc8ff_dc38_4f3b_bef4_3c997df9be83.slice/crio-f8b50f9de5c07f6d2f3b3082eb51fa39b32c7d71d094182c318ca3ff491cabd8 WatchSource:0}: Error finding container f8b50f9de5c07f6d2f3b3082eb51fa39b32c7d71d094182c318ca3ff491cabd8: Status 404 returned error can't find the container with id f8b50f9de5c07f6d2f3b3082eb51fa39b32c7d71d094182c318ca3ff491cabd8 Jun 05 13:43:17.951744 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:17.951704 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"516bc8ff-dc38-4f3b-bef4-3c997df9be83","Type":"ContainerStarted","Data":"f8b50f9de5c07f6d2f3b3082eb51fa39b32c7d71d094182c318ca3ff491cabd8"} Jun 05 13:43:22.141684 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:22.141661 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 13:43:22.983558 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:22.983514 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"516bc8ff-dc38-4f3b-bef4-3c997df9be83","Type":"ContainerStarted","Data":"3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c"} Jun 05 13:43:23.005530 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:23.005466 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.521837989 podStartE2EDuration="6.005444668s" totalImagesPullingTime="4.483606679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:43:23.003128258 +0000 UTC m=+1141.947422568" watchObservedRunningTime="2026-06-05 13:43:23.005444668 +0000 UTC m=+1141.949738982" Jun 05 13:43:23.514600 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:23.514557 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:23.516452 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:23.516411 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:24.514164 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:24.514117 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:25.514800 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:25.514752 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:26.514909 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:26.514869 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:27.514110 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:27.514065 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:27.515147 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:27.515103 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:28.514317 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:28.514262 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:29.514874 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:29.514827 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:30.514407 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:30.514359 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:31.514223 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:31.514169 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:32.514103 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:32.514025 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:33.514818 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:33.514771 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:34.514595 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:34.514553 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.39:9000/health/started\": dial tcp 10.132.0.39:9000: connect: connection refused" Jun 05 13:43:35.631682 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:35.631647 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:35.650000 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:35.649736 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:43:45.638250 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:45.638162 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 13:43:51.693011 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.692976 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f76759b55-9rs9f"] Jun 05 13:43:51.697235 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.695922 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.703354 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.700897 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c87cm\"" Jun 05 13:43:51.703354 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.701175 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 05 13:43:51.703354 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.701813 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 13:43:51.713437 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.713412 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f76759b55-9rs9f"] Jun 05 13:43:51.791677 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.791644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrcl\" (UniqueName: \"kubernetes.io/projected/ef571e9c-9bc4-43b7-afd6-1c566230fd96-kube-api-access-ffrcl\") pod \"maas-controller-7f76759b55-9rs9f\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.791842 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.791708 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef571e9c-9bc4-43b7-afd6-1c566230fd96-webhook-cert\") pod \"maas-controller-7f76759b55-9rs9f\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.892819 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.892786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrcl\" (UniqueName: \"kubernetes.io/projected/ef571e9c-9bc4-43b7-afd6-1c566230fd96-kube-api-access-ffrcl\") pod \"maas-controller-7f76759b55-9rs9f\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.893006 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.892844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef571e9c-9bc4-43b7-afd6-1c566230fd96-webhook-cert\") pod \"maas-controller-7f76759b55-9rs9f\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.895207 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.895185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef571e9c-9bc4-43b7-afd6-1c566230fd96-webhook-cert\") pod \"maas-controller-7f76759b55-9rs9f\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.905775 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.905745 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84d8b9cc64-fb76v"] Jun 05 13:43:51.908542 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.908524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:51.914482 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.914464 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrcl\" (UniqueName: \"kubernetes.io/projected/ef571e9c-9bc4-43b7-afd6-1c566230fd96-kube-api-access-ffrcl\") pod \"maas-controller-7f76759b55-9rs9f\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:51.931594 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.931572 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84d8b9cc64-fb76v"] Jun 05 13:43:51.993695 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.993664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhh8j\" (UniqueName: \"kubernetes.io/projected/8dba71a0-e94c-47ab-9311-bddd307f8097-kube-api-access-jhh8j\") pod \"maas-controller-84d8b9cc64-fb76v\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:51.993841 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:51.993699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dba71a0-e94c-47ab-9311-bddd307f8097-webhook-cert\") pod \"maas-controller-84d8b9cc64-fb76v\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:52.009565 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.009536 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:52.094628 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.094601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhh8j\" (UniqueName: \"kubernetes.io/projected/8dba71a0-e94c-47ab-9311-bddd307f8097-kube-api-access-jhh8j\") pod \"maas-controller-84d8b9cc64-fb76v\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:52.094777 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.094641 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dba71a0-e94c-47ab-9311-bddd307f8097-webhook-cert\") pod \"maas-controller-84d8b9cc64-fb76v\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:52.097800 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.097731 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dba71a0-e94c-47ab-9311-bddd307f8097-webhook-cert\") pod \"maas-controller-84d8b9cc64-fb76v\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:52.104173 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.104153 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhh8j\" (UniqueName: \"kubernetes.io/projected/8dba71a0-e94c-47ab-9311-bddd307f8097-kube-api-access-jhh8j\") pod \"maas-controller-84d8b9cc64-fb76v\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:52.140697 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.140672 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f76759b55-9rs9f"] Jun 05 13:43:52.142663 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:43:52.142628 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef571e9c_9bc4_43b7_afd6_1c566230fd96.slice/crio-9dcb7866841f02092ab390734ae15456c1aef1a287f199f92b6862acc1ea0285 WatchSource:0}: Error finding container 9dcb7866841f02092ab390734ae15456c1aef1a287f199f92b6862acc1ea0285: Status 404 returned error can't find the container with id 9dcb7866841f02092ab390734ae15456c1aef1a287f199f92b6862acc1ea0285 Jun 05 13:43:52.144136 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.144112 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 13:43:52.149284 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.149258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f76759b55-9rs9f" event={"ID":"ef571e9c-9bc4-43b7-afd6-1c566230fd96","Type":"ContainerStarted","Data":"9dcb7866841f02092ab390734ae15456c1aef1a287f199f92b6862acc1ea0285"} Jun 05 13:43:52.227687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.227655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:52.354296 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:52.354273 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84d8b9cc64-fb76v"] Jun 05 13:43:52.355739 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:43:52.355712 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dba71a0_e94c_47ab_9311_bddd307f8097.slice/crio-c5f07effe76448b785a88cd5d22a6262135d1d14d0aaa2a2e3d9820b606f29c4 WatchSource:0}: Error finding container c5f07effe76448b785a88cd5d22a6262135d1d14d0aaa2a2e3d9820b606f29c4: Status 404 returned error can't find the container with id c5f07effe76448b785a88cd5d22a6262135d1d14d0aaa2a2e3d9820b606f29c4 Jun 05 13:43:53.158779 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:53.158743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" event={"ID":"8dba71a0-e94c-47ab-9311-bddd307f8097","Type":"ContainerStarted","Data":"c5f07effe76448b785a88cd5d22a6262135d1d14d0aaa2a2e3d9820b606f29c4"} Jun 05 13:43:55.170391 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:55.170309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f76759b55-9rs9f" event={"ID":"ef571e9c-9bc4-43b7-afd6-1c566230fd96","Type":"ContainerStarted","Data":"3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c"} Jun 05 13:43:55.170914 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:55.170445 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:43:55.171994 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:55.171967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" event={"ID":"8dba71a0-e94c-47ab-9311-bddd307f8097","Type":"ContainerStarted","Data":"ba3e2a3642a9cb0ef35cf1cb49585cb7e3e4da80d760a6f1e705fd8196acaff5"} Jun 05 13:43:55.172177 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:55.172010 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:43:55.193485 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:55.193438 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f76759b55-9rs9f" podStartSLOduration=1.622759091 podStartE2EDuration="4.193425057s" totalImagesPullingTime="2.570665966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:43:55.190784349 +0000 UTC m=+1174.135078682" watchObservedRunningTime="2026-06-05 13:43:55.193425057 +0000 UTC m=+1174.137719365" Jun 05 13:43:55.209187 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:43:55.209150 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" podStartSLOduration=1.841921743 podStartE2EDuration="4.209137302s" totalImagesPullingTime="2.367215559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:43:55.208266445 +0000 UTC m=+1174.152560756" watchObservedRunningTime="2026-06-05 13:43:55.209137302 +0000 UTC m=+1174.153431611" Jun 05 13:44:06.182578 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.182550 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:44:06.183022 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.182822 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:44:06.242407 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.242374 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f76759b55-9rs9f"] Jun 05 13:44:06.242632 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.242596 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f76759b55-9rs9f" podUID="ef571e9c-9bc4-43b7-afd6-1c566230fd96" containerName="manager" containerID="cri-o://3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c" gracePeriod=30 Jun 05 13:44:06.485141 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.485114 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:44:06.624231 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.624203 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffrcl\" (UniqueName: \"kubernetes.io/projected/ef571e9c-9bc4-43b7-afd6-1c566230fd96-kube-api-access-ffrcl\") pod \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " Jun 05 13:44:06.624387 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.624309 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef571e9c-9bc4-43b7-afd6-1c566230fd96-webhook-cert\") pod \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\" (UID: \"ef571e9c-9bc4-43b7-afd6-1c566230fd96\") " Jun 05 13:44:06.626391 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.626365 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef571e9c-9bc4-43b7-afd6-1c566230fd96-kube-api-access-ffrcl" (OuterVolumeSpecName: "kube-api-access-ffrcl") pod "ef571e9c-9bc4-43b7-afd6-1c566230fd96" (UID: "ef571e9c-9bc4-43b7-afd6-1c566230fd96"). InnerVolumeSpecName "kube-api-access-ffrcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:44:06.626391 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.626383 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef571e9c-9bc4-43b7-afd6-1c566230fd96-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ef571e9c-9bc4-43b7-afd6-1c566230fd96" (UID: "ef571e9c-9bc4-43b7-afd6-1c566230fd96"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:44:06.724982 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.724917 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffrcl\" (UniqueName: \"kubernetes.io/projected/ef571e9c-9bc4-43b7-afd6-1c566230fd96-kube-api-access-ffrcl\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:44:06.724982 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:06.724948 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef571e9c-9bc4-43b7-afd6-1c566230fd96-webhook-cert\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:44:07.233661 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.233623 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef571e9c-9bc4-43b7-afd6-1c566230fd96" containerID="3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c" exitCode=0 Jun 05 13:44:07.234119 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.233669 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f76759b55-9rs9f" Jun 05 13:44:07.234119 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.233710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f76759b55-9rs9f" event={"ID":"ef571e9c-9bc4-43b7-afd6-1c566230fd96","Type":"ContainerDied","Data":"3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c"} Jun 05 13:44:07.234119 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.233760 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f76759b55-9rs9f" event={"ID":"ef571e9c-9bc4-43b7-afd6-1c566230fd96","Type":"ContainerDied","Data":"9dcb7866841f02092ab390734ae15456c1aef1a287f199f92b6862acc1ea0285"} Jun 05 13:44:07.234119 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.233783 2565 scope.go:117] "RemoveContainer" containerID="3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c" Jun 05 13:44:07.242576 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.242556 2565 scope.go:117] "RemoveContainer" containerID="3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c" Jun 05 13:44:07.242821 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:44:07.242801 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c\": container with ID starting with 3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c not found: ID does not exist" containerID="3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c" Jun 05 13:44:07.242877 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.242830 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c"} err="failed to get container status \"3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c\": rpc error: code = NotFound desc = could not find container \"3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c\": container with ID starting with 3070d7f15d52701a8f42ef6577d1f5e192f60d92bbf4196ec2302b4d1fa5c98c not found: ID does not exist" Jun 05 13:44:07.254284 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.254262 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f76759b55-9rs9f"] Jun 05 13:44:07.258066 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.258030 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f76759b55-9rs9f"] Jun 05 13:44:07.464505 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:07.464475 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef571e9c-9bc4-43b7-afd6-1c566230fd96" path="/var/lib/kubelet/pods/ef571e9c-9bc4-43b7-afd6-1c566230fd96/volumes" Jun 05 13:44:21.997625 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:21.997593 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:44:22.001089 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:22.001066 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:44:22.005937 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:22.005919 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:44:22.009137 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:22.009119 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:44:26.438344 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.438305 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d675c6b48-7c6tm"] Jun 05 13:44:26.438919 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.438900 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef571e9c-9bc4-43b7-afd6-1c566230fd96" containerName="manager" Jun 05 13:44:26.439003 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.438923 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef571e9c-9bc4-43b7-afd6-1c566230fd96" containerName="manager" Jun 05 13:44:26.439077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.439026 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef571e9c-9bc4-43b7-afd6-1c566230fd96" containerName="manager" Jun 05 13:44:26.442274 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.442252 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:26.445288 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.445264 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mjrsp\"" Jun 05 13:44:26.445407 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.445283 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 05 13:44:26.454737 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.454716 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d675c6b48-7c6tm"] Jun 05 13:44:26.508348 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.508316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/676f6b61-beb4-478f-872c-a679bd95f6ae-maas-api-tls\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:26.508526 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.508359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc7gx\" (UniqueName: \"kubernetes.io/projected/676f6b61-beb4-478f-872c-a679bd95f6ae-kube-api-access-hc7gx\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:26.609891 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.609853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/676f6b61-beb4-478f-872c-a679bd95f6ae-maas-api-tls\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:26.610097 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.609903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc7gx\" (UniqueName: \"kubernetes.io/projected/676f6b61-beb4-478f-872c-a679bd95f6ae-kube-api-access-hc7gx\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:26.610097 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:44:26.610055 2565 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 13:44:26.610224 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:44:26.610193 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/676f6b61-beb4-478f-872c-a679bd95f6ae-maas-api-tls podName:676f6b61-beb4-478f-872c-a679bd95f6ae nodeName:}" failed. No retries permitted until 2026-06-05 13:44:27.110134138 +0000 UTC m=+1206.054428444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/676f6b61-beb4-478f-872c-a679bd95f6ae-maas-api-tls") pod "maas-api-5d675c6b48-7c6tm" (UID: "676f6b61-beb4-478f-872c-a679bd95f6ae") : secret "maas-api-serving-cert" not found Jun 05 13:44:26.621309 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.621287 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc7gx\" (UniqueName: \"kubernetes.io/projected/676f6b61-beb4-478f-872c-a679bd95f6ae-kube-api-access-hc7gx\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:26.931715 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.931684 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-czvd9"] Jun 05 13:44:26.934949 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.934928 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:26.937616 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.937587 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 13:44:26.937727 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.937636 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bxnq4\"" Jun 05 13:44:26.947261 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.947236 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-czvd9"] Jun 05 13:44:26.967425 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.967399 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-6bt44"] Jun 05 13:44:26.969788 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.969770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:26.978944 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:26.978920 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-6bt44"] Jun 05 13:44:27.014205 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.014180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfpx\" (UniqueName: \"kubernetes.io/projected/d9635ce0-2b41-4cf7-848e-01ae0e7ca08b-kube-api-access-ckfpx\") pod \"payload-pre-processing-67d7689b65-czvd9\" (UID: \"d9635ce0-2b41-4cf7-848e-01ae0e7ca08b\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:27.115144 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.115108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfpx\" (UniqueName: \"kubernetes.io/projected/d9635ce0-2b41-4cf7-848e-01ae0e7ca08b-kube-api-access-ckfpx\") pod \"payload-pre-processing-67d7689b65-czvd9\" (UID: \"d9635ce0-2b41-4cf7-848e-01ae0e7ca08b\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:27.115350 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.115160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhc57\" (UniqueName: \"kubernetes.io/projected/244b70ad-0825-46dd-a74e-67e649421f60-kube-api-access-nhc57\") pod \"payload-processing-7c6c859784-6bt44\" (UID: \"244b70ad-0825-46dd-a74e-67e649421f60\") " pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:27.115350 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.115214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/676f6b61-beb4-478f-872c-a679bd95f6ae-maas-api-tls\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:27.117721 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.117693 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/676f6b61-beb4-478f-872c-a679bd95f6ae-maas-api-tls\") pod \"maas-api-5d675c6b48-7c6tm\" (UID: \"676f6b61-beb4-478f-872c-a679bd95f6ae\") " pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:27.123605 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.123561 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfpx\" (UniqueName: \"kubernetes.io/projected/d9635ce0-2b41-4cf7-848e-01ae0e7ca08b-kube-api-access-ckfpx\") pod \"payload-pre-processing-67d7689b65-czvd9\" (UID: \"d9635ce0-2b41-4cf7-848e-01ae0e7ca08b\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:27.216804 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.216765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhc57\" (UniqueName: \"kubernetes.io/projected/244b70ad-0825-46dd-a74e-67e649421f60-kube-api-access-nhc57\") pod \"payload-processing-7c6c859784-6bt44\" (UID: \"244b70ad-0825-46dd-a74e-67e649421f60\") " pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:27.225354 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.225325 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhc57\" (UniqueName: \"kubernetes.io/projected/244b70ad-0825-46dd-a74e-67e649421f60-kube-api-access-nhc57\") pod \"payload-processing-7c6c859784-6bt44\" (UID: \"244b70ad-0825-46dd-a74e-67e649421f60\") " pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:27.246143 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.246113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:27.281427 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.281394 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:27.352773 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.352743 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:27.391823 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.391780 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-czvd9"] Jun 05 13:44:27.395747 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:44:27.395679 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9635ce0_2b41_4cf7_848e_01ae0e7ca08b.slice/crio-1fd808d0c34c4ddc25f8a9143474e1776b0135def01cf8192ff484b77367e43d WatchSource:0}: Error finding container 1fd808d0c34c4ddc25f8a9143474e1776b0135def01cf8192ff484b77367e43d: Status 404 returned error can't find the container with id 1fd808d0c34c4ddc25f8a9143474e1776b0135def01cf8192ff484b77367e43d Jun 05 13:44:27.433879 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.433857 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-6bt44"] Jun 05 13:44:27.435931 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:44:27.435903 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244b70ad_0825_46dd_a74e_67e649421f60.slice/crio-6761b68ba5902e82e297a3292942d453645b549d16f445d13fef9ffcda3b3988 WatchSource:0}: Error finding container 6761b68ba5902e82e297a3292942d453645b549d16f445d13fef9ffcda3b3988: Status 404 returned error can't find the container with id 6761b68ba5902e82e297a3292942d453645b549d16f445d13fef9ffcda3b3988 Jun 05 13:44:27.502839 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:44:27.502811 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676f6b61_beb4_478f_872c_a679bd95f6ae.slice/crio-e57ec4c3d4e0bfaa3a746952700826db1d2c5a070adbc15087254c8ea2c7aca5 WatchSource:0}: Error finding container e57ec4c3d4e0bfaa3a746952700826db1d2c5a070adbc15087254c8ea2c7aca5: Status 404 returned error can't find the container with id e57ec4c3d4e0bfaa3a746952700826db1d2c5a070adbc15087254c8ea2c7aca5 Jun 05 13:44:27.503181 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:27.502836 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d675c6b48-7c6tm"] Jun 05 13:44:28.351448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:28.351321 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d675c6b48-7c6tm" event={"ID":"676f6b61-beb4-478f-872c-a679bd95f6ae","Type":"ContainerStarted","Data":"e57ec4c3d4e0bfaa3a746952700826db1d2c5a070adbc15087254c8ea2c7aca5"} Jun 05 13:44:28.354365 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:28.354327 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" event={"ID":"d9635ce0-2b41-4cf7-848e-01ae0e7ca08b","Type":"ContainerStarted","Data":"1fd808d0c34c4ddc25f8a9143474e1776b0135def01cf8192ff484b77367e43d"} Jun 05 13:44:28.356691 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:28.356665 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" event={"ID":"244b70ad-0825-46dd-a74e-67e649421f60","Type":"ContainerStarted","Data":"6761b68ba5902e82e297a3292942d453645b549d16f445d13fef9ffcda3b3988"} Jun 05 13:44:31.374007 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.373917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d675c6b48-7c6tm" event={"ID":"676f6b61-beb4-478f-872c-a679bd95f6ae","Type":"ContainerStarted","Data":"bbba518b7ae98e31179f5546f620cfd0b977ba18603af442845c4d47e4076b95"} Jun 05 13:44:31.374497 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.374012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:31.375608 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.375579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" event={"ID":"d9635ce0-2b41-4cf7-848e-01ae0e7ca08b","Type":"ContainerStarted","Data":"9d9f3015b59ff1891d3f6ce08571829f4bb7d0085b805419a78c7f06bb778595"} Jun 05 13:44:31.375750 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.375644 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:31.377389 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.377369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" event={"ID":"244b70ad-0825-46dd-a74e-67e649421f60","Type":"ContainerStarted","Data":"b5565ff0bf4ee63b0db81e9a726ac982098959e1da1c11cd7db66ca2466e6718"} Jun 05 13:44:31.377510 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.377489 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:31.394577 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.394516 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5d675c6b48-7c6tm" podStartSLOduration=1.9254494819999999 podStartE2EDuration="5.394498418s" totalImagesPullingTime="3.469048936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:44:31.393326671 +0000 UTC m=+1210.337620982" watchObservedRunningTime="2026-06-05 13:44:31.394498418 +0000 UTC m=+1210.338792728" Jun 05 13:44:31.431820 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.431765 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" podStartSLOduration=1.7650459280000002 podStartE2EDuration="5.431749945s" totalImagesPullingTime="3.666704017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:44:31.429652792 +0000 UTC m=+1210.373947102" watchObservedRunningTime="2026-06-05 13:44:31.431749945 +0000 UTC m=+1210.376044282" Jun 05 13:44:31.454805 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:31.454751 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" podStartSLOduration=1.82187755 podStartE2EDuration="5.454737099s" totalImagesPullingTime="3.632859549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:44:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:44:31.453413601 +0000 UTC m=+1210.397707922" watchObservedRunningTime="2026-06-05 13:44:31.454737099 +0000 UTC m=+1210.399031404" Jun 05 13:44:35.398294 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:35.398260 2565 generic.go:356] "Generic (PLEG): container finished" podID="161b9951-a0f4-40d2-bb77-c162bc4be92b" containerID="f5d31f7a40159526775336a774ae86d79a46a544123f4e4be7b70582a055ed44" exitCode=0 Jun 05 13:44:35.398721 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:35.398308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" event={"ID":"161b9951-a0f4-40d2-bb77-c162bc4be92b","Type":"ContainerDied","Data":"f5d31f7a40159526775336a774ae86d79a46a544123f4e4be7b70582a055ed44"} Jun 05 13:44:35.398721 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:35.398682 2565 scope.go:117] "RemoveContainer" containerID="f5d31f7a40159526775336a774ae86d79a46a544123f4e4be7b70582a055ed44" Jun 05 13:44:35.399648 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:35.399618 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:44:35.399737 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:35.399690 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:44:35.399737 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:35.399726 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 13:44:36.410224 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:36.410188 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" event={"ID":"161b9951-a0f4-40d2-bb77-c162bc4be92b","Type":"ContainerStarted","Data":"678a10c9ccb98804459a18645e6993b2232ee458c34005ab2f04d2ff0a54b3f6"} Jun 05 13:44:36.925381 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:36.925348 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:44:36.925614 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:36.925591 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-v5kvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 05 13:44:36.925668 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:36.925641 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" podUID="161b9951-a0f4-40d2-bb77-c162bc4be92b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 05 13:44:37.396368 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:37.396327 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d675c6b48-7c6tm" Jun 05 13:44:37.925585 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:37.925551 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-v5kvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 05 13:44:37.925968 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:37.925607 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" podUID="161b9951-a0f4-40d2-bb77-c162bc4be92b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 05 13:44:38.925214 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:38.925179 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-v5kvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 05 13:44:38.925397 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:38.925258 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" podUID="161b9951-a0f4-40d2-bb77-c162bc4be92b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 05 13:44:39.172474 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:39.172442 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:44:39.172876 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:39.172634 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" containerID="cri-o://3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c" gracePeriod=30 Jun 05 13:44:39.926101 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:39.926060 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-v5kvz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body= Jun 05 13:44:39.926289 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:39.926119 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" podUID="161b9951-a0f4-40d2-bb77-c162bc4be92b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" Jun 05 13:44:40.826850 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:40.826828 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:40.929402 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:40.929328 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:44:40.929607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:40.929583 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:44:40.930357 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:40.930335 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-v5kvz" Jun 05 13:44:40.957714 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:40.957686 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmx6v\" (UniqueName: \"kubernetes.io/projected/516bc8ff-dc38-4f3b-bef4-3c997df9be83-kube-api-access-fmx6v\") pod \"516bc8ff-dc38-4f3b-bef4-3c997df9be83\" (UID: \"516bc8ff-dc38-4f3b-bef4-3c997df9be83\") " Jun 05 13:44:40.959783 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:40.959763 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516bc8ff-dc38-4f3b-bef4-3c997df9be83-kube-api-access-fmx6v" (OuterVolumeSpecName: "kube-api-access-fmx6v") pod "516bc8ff-dc38-4f3b-bef4-3c997df9be83" (UID: "516bc8ff-dc38-4f3b-bef4-3c997df9be83"). InnerVolumeSpecName "kube-api-access-fmx6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:44:41.059321 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.059290 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmx6v\" (UniqueName: \"kubernetes.io/projected/516bc8ff-dc38-4f3b-bef4-3c997df9be83-kube-api-access-fmx6v\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:44:41.437867 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.437832 2565 generic.go:356] "Generic (PLEG): container finished" podID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerID="3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c" exitCode=143 Jun 05 13:44:41.438070 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.437878 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.438070 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.437918 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"516bc8ff-dc38-4f3b-bef4-3c997df9be83","Type":"ContainerDied","Data":"3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c"} Jun 05 13:44:41.438070 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.437966 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"516bc8ff-dc38-4f3b-bef4-3c997df9be83","Type":"ContainerDied","Data":"f8b50f9de5c07f6d2f3b3082eb51fa39b32c7d71d094182c318ca3ff491cabd8"} Jun 05 13:44:41.438070 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.437990 2565 scope.go:117] "RemoveContainer" containerID="3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c" Jun 05 13:44:41.447942 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.447919 2565 scope.go:117] "RemoveContainer" containerID="3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c" Jun 05 13:44:41.448222 ip-10-0-142-213 kubenswrapper[2565]: E0605 13:44:41.448203 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c\": container with ID starting with 3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c not found: ID does not exist" containerID="3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c" Jun 05 13:44:41.448275 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.448230 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c"} err="failed to get container status \"3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c\": rpc error: code = NotFound desc = could not find container \"3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c\": container with ID starting with 3ed9421a7856992ed44821edae13799cb9eb3b999420f6c0aa7a75349973572c not found: ID does not exist" Jun 05 13:44:41.465350 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.465328 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:44:41.465465 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.465359 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:44:41.487067 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.487030 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:44:41.487421 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.487410 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" Jun 05 13:44:41.487459 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.487424 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" Jun 05 13:44:41.487502 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.487493 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" containerName="keycloak" Jun 05 13:44:41.490214 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.490198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.492457 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.492434 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 13:44:41.492457 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.492435 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 13:44:41.492657 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.492444 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-g5q65\"" Jun 05 13:44:41.492657 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.492479 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 13:44:41.492746 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.492705 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 13:44:41.499025 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.499005 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:44:41.564576 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.564556 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1-test-realms\") pod \"maas-keycloak-0\" (UID: \"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.564688 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.564612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mppvf\" (UniqueName: \"kubernetes.io/projected/99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1-kube-api-access-mppvf\") pod \"maas-keycloak-0\" (UID: \"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.665354 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.665331 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1-test-realms\") pod \"maas-keycloak-0\" (UID: \"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.665445 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.665369 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mppvf\" (UniqueName: \"kubernetes.io/projected/99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1-kube-api-access-mppvf\") pod \"maas-keycloak-0\" (UID: \"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.665957 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.665939 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1-test-realms\") pod \"maas-keycloak-0\" (UID: \"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.673915 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.673895 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mppvf\" (UniqueName: \"kubernetes.io/projected/99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1-kube-api-access-mppvf\") pod \"maas-keycloak-0\" (UID: \"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1\") " pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.800165 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.800138 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:41.927448 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:41.927422 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 13:44:41.928102 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:44:41.928075 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f5c895_ddb5_46b7_a035_a5b8e8bf1fd1.slice/crio-ee2e1d6eaf10a4cfc546a543c2c9d7ed40a7cf135c991dd5bf29287d83fff4cd WatchSource:0}: Error finding container ee2e1d6eaf10a4cfc546a543c2c9d7ed40a7cf135c991dd5bf29287d83fff4cd: Status 404 returned error can't find the container with id ee2e1d6eaf10a4cfc546a543c2c9d7ed40a7cf135c991dd5bf29287d83fff4cd Jun 05 13:44:42.385272 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.385236 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-6bt44" Jun 05 13:44:42.385542 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.385521 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-czvd9" Jun 05 13:44:42.448804 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.448771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1","Type":"ContainerStarted","Data":"7323d0222531c273aae6635154a386f65e344d24242bd500130fb0106eb45627"} Jun 05 13:44:42.448995 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.448826 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1","Type":"ContainerStarted","Data":"ee2e1d6eaf10a4cfc546a543c2c9d7ed40a7cf135c991dd5bf29287d83fff4cd"} Jun 05 13:44:42.466976 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.466926 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.166031985 podStartE2EDuration="1.466910351s" totalImagesPullingTime="300.878366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:44:42.465011171 +0000 UTC m=+1221.409305482" watchObservedRunningTime="2026-06-05 13:44:42.466910351 +0000 UTC m=+1221.411204659" Jun 05 13:44:42.800898 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.800864 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:42.802410 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:42.802373 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:43.470377 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:43.470341 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516bc8ff-dc38-4f3b-bef4-3c997df9be83" path="/var/lib/kubelet/pods/516bc8ff-dc38-4f3b-bef4-3c997df9be83/volumes" Jun 05 13:44:43.801402 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:43.801305 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:44.801516 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:44.801457 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:45.801063 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:45.800980 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:46.801619 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:46.801567 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:47.800655 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:47.800603 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:48.802059 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:48.801449 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:49.801510 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:49.801465 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:50.801621 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:50.801568 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:51.800728 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:51.800690 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:51.801158 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:51.801121 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:52.801304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:52.801252 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:53.800667 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:53.800629 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:54.800670 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:54.800623 2565 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 05 13:44:55.914569 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:55.914514 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 13:44:55.929353 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:44:55.929307 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:45:05.919432 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:05.919375 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="99f5c895-ddb5-46b7-a035-a5b8e8bf1fd1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:45:15.921798 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:15.921767 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 13:45:37.119083 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.119028 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j"] Jun 05 13:45:37.124209 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.124191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.127644 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.127626 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 13:45:37.128838 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.128821 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 13:45:37.129059 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.129025 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 13:45:37.129197 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.129114 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sxkzt\"" Jun 05 13:45:37.135808 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.135786 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j"] Jun 05 13:45:37.203418 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.203391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.203511 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.203438 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnm4k\" (UniqueName: \"kubernetes.io/projected/bc8fa722-5c21-4352-9817-8b759179ace9-kube-api-access-pnm4k\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.203511 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.203458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.203596 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.203531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8fa722-5c21-4352-9817-8b759179ace9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.203596 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.203571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.203662 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.203613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304162 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8fa722-5c21-4352-9817-8b759179ace9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304246 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304304 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnm4k\" (UniqueName: \"kubernetes.io/projected/bc8fa722-5c21-4352-9817-8b759179ace9-kube-api-access-pnm4k\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304458 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304658 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304640 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304722 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304694 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.304765 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.304746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.306473 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.306454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc8fa722-5c21-4352-9817-8b759179ace9-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.306782 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.306765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc8fa722-5c21-4352-9817-8b759179ace9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.311826 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.311803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnm4k\" (UniqueName: \"kubernetes.io/projected/bc8fa722-5c21-4352-9817-8b759179ace9-kube-api-access-pnm4k\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j\" (UID: \"bc8fa722-5c21-4352-9817-8b759179ace9\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.434862 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.434804 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:37.569449 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.569233 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j"] Jun 05 13:45:37.767764 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:37.767727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" event={"ID":"bc8fa722-5c21-4352-9817-8b759179ace9","Type":"ContainerStarted","Data":"6f37b88a398e5c88957a728ea5ade73750447e600d9cb222d6c019840427389e"} Jun 05 13:45:41.793973 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:41.793941 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" event={"ID":"bc8fa722-5c21-4352-9817-8b759179ace9","Type":"ContainerStarted","Data":"bcece5fddbb249f27b8d6060a11f3854246caf0146738ae5cf2a02cb2a388c7a"} Jun 05 13:45:43.814584 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:43.814551 2565 generic.go:356] "Generic (PLEG): container finished" podID="bc8fa722-5c21-4352-9817-8b759179ace9" containerID="bcece5fddbb249f27b8d6060a11f3854246caf0146738ae5cf2a02cb2a388c7a" exitCode=0 Jun 05 13:45:43.814942 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:43.814627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" event={"ID":"bc8fa722-5c21-4352-9817-8b759179ace9","Type":"ContainerDied","Data":"bcece5fddbb249f27b8d6060a11f3854246caf0146738ae5cf2a02cb2a388c7a"} Jun 05 13:45:45.828996 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:45.828960 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" event={"ID":"bc8fa722-5c21-4352-9817-8b759179ace9","Type":"ContainerStarted","Data":"db3c93bb9c0ef744f668346b72103c4d1fb80177b09fb39d7c682f2124f2fe35"} Jun 05 13:45:45.851292 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:45.851240 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" podStartSLOduration=2.233468553 podStartE2EDuration="8.851225986s" totalImagesPullingTime="5.369278197s" totalInitContainerRuntime="1.248479236s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:45:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:45:45.848991388 +0000 UTC m=+1284.793285696" watchObservedRunningTime="2026-06-05 13:45:45.851225986 +0000 UTC m=+1284.795520295" Jun 05 13:45:47.435859 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:47.435826 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:47.436319 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:47.436143 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:47.448897 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:47.448874 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:45:47.850075 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:45:47.850024 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j" Jun 05 13:46:05.403498 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.403461 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn"] Jun 05 13:46:05.418621 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.418596 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn"] Jun 05 13:46:05.418780 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.418703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.421856 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.421836 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 05 13:46:05.572687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.572656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.572878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.572700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsbc\" (UniqueName: \"kubernetes.io/projected/e060b2d9-89c5-4a63-893e-97b06bf52dcf-kube-api-access-qhsbc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.572878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.572725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.572878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.572810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.572878 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.572861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e060b2d9-89c5-4a63-893e-97b06bf52dcf-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.573116 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.572959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.673981 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.673911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674129 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.673979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674129 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsbc\" (UniqueName: \"kubernetes.io/projected/e060b2d9-89c5-4a63-893e-97b06bf52dcf-kube-api-access-qhsbc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674129 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674129 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674290 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e060b2d9-89c5-4a63-893e-97b06bf52dcf-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674397 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674356 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674527 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674395 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.674527 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.674473 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.676190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.676163 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e060b2d9-89c5-4a63-893e-97b06bf52dcf-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.676504 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.676485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e060b2d9-89c5-4a63-893e-97b06bf52dcf-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.682169 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.682147 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsbc\" (UniqueName: \"kubernetes.io/projected/e060b2d9-89c5-4a63-893e-97b06bf52dcf-kube-api-access-qhsbc\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-2thwn\" (UID: \"e060b2d9-89c5-4a63-893e-97b06bf52dcf\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.733017 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.732996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:05.868697 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.868641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn"] Jun 05 13:46:05.871377 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:46:05.871347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode060b2d9_89c5_4a63_893e_97b06bf52dcf.slice/crio-ed249cbcd66e9771e3a866e4bcab6273222d783a07f6a978d0d8e8846da56ea8 WatchSource:0}: Error finding container ed249cbcd66e9771e3a866e4bcab6273222d783a07f6a978d0d8e8846da56ea8: Status 404 returned error can't find the container with id ed249cbcd66e9771e3a866e4bcab6273222d783a07f6a978d0d8e8846da56ea8 Jun 05 13:46:05.930013 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:05.929983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" event={"ID":"e060b2d9-89c5-4a63-893e-97b06bf52dcf","Type":"ContainerStarted","Data":"ed249cbcd66e9771e3a866e4bcab6273222d783a07f6a978d0d8e8846da56ea8"} Jun 05 13:46:06.936286 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:06.936248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" event={"ID":"e060b2d9-89c5-4a63-893e-97b06bf52dcf","Type":"ContainerStarted","Data":"50d9997e5d650e36619711b9a3ffdbf9ab7bc8bba73664e42b523fd5d1a111e5"} Jun 05 13:46:07.942824 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:07.942786 2565 generic.go:356] "Generic (PLEG): container finished" podID="e060b2d9-89c5-4a63-893e-97b06bf52dcf" containerID="50d9997e5d650e36619711b9a3ffdbf9ab7bc8bba73664e42b523fd5d1a111e5" exitCode=0 Jun 05 13:46:07.943243 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:07.942876 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" event={"ID":"e060b2d9-89c5-4a63-893e-97b06bf52dcf","Type":"ContainerDied","Data":"50d9997e5d650e36619711b9a3ffdbf9ab7bc8bba73664e42b523fd5d1a111e5"} Jun 05 13:46:08.949486 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:08.949442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" event={"ID":"e060b2d9-89c5-4a63-893e-97b06bf52dcf","Type":"ContainerStarted","Data":"415f03adde45b902ec75c25af7070c7f579a318a175f6752ac735c327c333553"} Jun 05 13:46:08.971077 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:08.971013 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" podStartSLOduration=2.449709448 podStartE2EDuration="3.971000042s" totalImagesPullingTime="265.652451ms" totalInitContainerRuntime="1.255638143s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:46:08.969306623 +0000 UTC m=+1307.913600933" watchObservedRunningTime="2026-06-05 13:46:08.971000042 +0000 UTC m=+1307.915294350" Jun 05 13:46:15.733486 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:15.733404 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:15.733901 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:15.733514 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:15.745556 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:15.745537 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:15.994200 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:15.994118 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-2thwn" Jun 05 13:46:18.426677 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.426645 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s"] Jun 05 13:46:18.430026 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.430009 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.432663 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.432643 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 05 13:46:18.440049 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.440020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s"] Jun 05 13:46:18.490636 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.490613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.490741 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.490658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.490741 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.490679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e28dee6-ee82-499f-9c75-190f2cfeb508-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.490741 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.490702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.490741 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.490735 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.490924 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.490762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgm4g\" (UniqueName: \"kubernetes.io/projected/1e28dee6-ee82-499f-9c75-190f2cfeb508-kube-api-access-fgm4g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.591607 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.591580 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.591779 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.591629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.591779 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.591658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e28dee6-ee82-499f-9c75-190f2cfeb508-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.591779 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.591681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.591779 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.591717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.591779 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.591758 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgm4g\" (UniqueName: \"kubernetes.io/projected/1e28dee6-ee82-499f-9c75-190f2cfeb508-kube-api-access-fgm4g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.592091 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.592055 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.592151 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.592092 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.592191 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.592159 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.594149 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.594126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e28dee6-ee82-499f-9c75-190f2cfeb508-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.594322 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.594307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e28dee6-ee82-499f-9c75-190f2cfeb508-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.601353 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.601331 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgm4g\" (UniqueName: \"kubernetes.io/projected/1e28dee6-ee82-499f-9c75-190f2cfeb508-kube-api-access-fgm4g\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s\" (UID: \"1e28dee6-ee82-499f-9c75-190f2cfeb508\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.741219 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.741182 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:18.889105 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:18.889077 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s"] Jun 05 13:46:18.890697 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:46:18.890673 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e28dee6_ee82_499f_9c75_190f2cfeb508.slice/crio-f3a18555ec2966d1d813774ddaea6677ac9ee3ff59b5294ee10b14dc71ff7ed1 WatchSource:0}: Error finding container f3a18555ec2966d1d813774ddaea6677ac9ee3ff59b5294ee10b14dc71ff7ed1: Status 404 returned error can't find the container with id f3a18555ec2966d1d813774ddaea6677ac9ee3ff59b5294ee10b14dc71ff7ed1 Jun 05 13:46:19.006637 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:19.006546 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" event={"ID":"1e28dee6-ee82-499f-9c75-190f2cfeb508","Type":"ContainerStarted","Data":"f33311ba51e598f963d8d924525474cf9813842e175eb5c0643fb6efda3786f1"} Jun 05 13:46:19.006637 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:19.006629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" event={"ID":"1e28dee6-ee82-499f-9c75-190f2cfeb508","Type":"ContainerStarted","Data":"f3a18555ec2966d1d813774ddaea6677ac9ee3ff59b5294ee10b14dc71ff7ed1"} Jun 05 13:46:36.098555 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:36.098522 2565 generic.go:356] "Generic (PLEG): container finished" podID="1e28dee6-ee82-499f-9c75-190f2cfeb508" containerID="f33311ba51e598f963d8d924525474cf9813842e175eb5c0643fb6efda3786f1" exitCode=0 Jun 05 13:46:36.098981 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:36.098600 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" event={"ID":"1e28dee6-ee82-499f-9c75-190f2cfeb508","Type":"ContainerDied","Data":"f33311ba51e598f963d8d924525474cf9813842e175eb5c0643fb6efda3786f1"} Jun 05 13:46:37.105381 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:37.105344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" event={"ID":"1e28dee6-ee82-499f-9c75-190f2cfeb508","Type":"ContainerStarted","Data":"e35bb181f6ce22028b3a0fcdb7f8720552a09d26e1685d34290ff819fb939bf1"} Jun 05 13:46:37.126748 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:37.126697 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" podStartSLOduration=2.709505359 podStartE2EDuration="19.126680999s" totalImagesPullingTime="232.410859ms" totalInitContainerRuntime="16.184764781s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:46:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:46:37.125589875 +0000 UTC m=+1336.069884196" watchObservedRunningTime="2026-06-05 13:46:37.126680999 +0000 UTC m=+1336.070975308" Jun 05 13:46:38.741938 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:38.741905 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:38.742362 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:38.741968 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:38.754190 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:38.754163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:39.127445 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:39.127351 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s" Jun 05 13:46:46.991726 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:46.991644 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh"] Jun 05 13:46:46.997461 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:46.997439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.000216 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.000199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 05 13:46:47.006788 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.006768 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh"] Jun 05 13:46:47.078921 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.078884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45be97b3-76e3-4d6f-8782-da19c433bec4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.078921 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.078922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.079205 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.078942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.079205 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.079061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v2gm\" (UniqueName: \"kubernetes.io/projected/45be97b3-76e3-4d6f-8782-da19c433bec4-kube-api-access-7v2gm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.079205 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.079150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.079332 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.079247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.179976 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.179943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v2gm\" (UniqueName: \"kubernetes.io/projected/45be97b3-76e3-4d6f-8782-da19c433bec4-kube-api-access-7v2gm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180192 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.179998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180192 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180192 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45be97b3-76e3-4d6f-8782-da19c433bec4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180375 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180375 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180541 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180512 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180617 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.180673 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.180637 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.182406 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.182377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45be97b3-76e3-4d6f-8782-da19c433bec4-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.182716 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.182696 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45be97b3-76e3-4d6f-8782-da19c433bec4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.188588 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.188564 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v2gm\" (UniqueName: \"kubernetes.io/projected/45be97b3-76e3-4d6f-8782-da19c433bec4-kube-api-access-7v2gm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bp5rh\" (UID: \"45be97b3-76e3-4d6f-8782-da19c433bec4\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.309434 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.309350 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:47.446747 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:47.446717 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh"] Jun 05 13:46:47.448503 ip-10-0-142-213 kubenswrapper[2565]: W0605 13:46:47.448474 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45be97b3_76e3_4d6f_8782_da19c433bec4.slice/crio-a8cb705cf87b61900c26675f42ea01e6c64f8f9232630dbce9eb5476fb30c4cf WatchSource:0}: Error finding container a8cb705cf87b61900c26675f42ea01e6c64f8f9232630dbce9eb5476fb30c4cf: Status 404 returned error can't find the container with id a8cb705cf87b61900c26675f42ea01e6c64f8f9232630dbce9eb5476fb30c4cf Jun 05 13:46:48.163757 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:48.163722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" event={"ID":"45be97b3-76e3-4d6f-8782-da19c433bec4","Type":"ContainerStarted","Data":"ccfff90e8ecff29c02f34d6c08c8cf47ad0d52a249797b5f596be7d3d95a49e4"} Jun 05 13:46:48.164150 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:48.163765 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" event={"ID":"45be97b3-76e3-4d6f-8782-da19c433bec4","Type":"ContainerStarted","Data":"a8cb705cf87b61900c26675f42ea01e6c64f8f9232630dbce9eb5476fb30c4cf"} Jun 05 13:46:51.186129 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:51.186092 2565 generic.go:356] "Generic (PLEG): container finished" podID="45be97b3-76e3-4d6f-8782-da19c433bec4" containerID="ccfff90e8ecff29c02f34d6c08c8cf47ad0d52a249797b5f596be7d3d95a49e4" exitCode=0 Jun 05 13:46:51.186487 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:51.186140 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" event={"ID":"45be97b3-76e3-4d6f-8782-da19c433bec4","Type":"ContainerDied","Data":"ccfff90e8ecff29c02f34d6c08c8cf47ad0d52a249797b5f596be7d3d95a49e4"} Jun 05 13:46:52.193295 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:52.193261 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" event={"ID":"45be97b3-76e3-4d6f-8782-da19c433bec4","Type":"ContainerStarted","Data":"358b0538fc2733775dd07a1e8c8f47ea226acabfd10560220acb55b441973aab"} Jun 05 13:46:52.213898 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:52.213839 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" podStartSLOduration=2.964835937 podStartE2EDuration="6.213825351s" totalImagesPullingTime="337.766786ms" totalInitContainerRuntime="2.911222628s" isStatefulPod=false podCreationTimestamp="2026-06-05 13:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 13:46:52.212317473 +0000 UTC m=+1351.156611782" watchObservedRunningTime="2026-06-05 13:46:52.213825351 +0000 UTC m=+1351.158119681" Jun 05 13:46:57.309906 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:57.309872 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:57.310369 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:57.310012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:57.322364 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:57.322341 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:46:58.236468 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:46:58.236442 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bp5rh" Jun 05 13:47:19.663115 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:47:19.663076 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-gsz5v" podUID="3f5309f4-e8bc-411f-81dc-fc842320ce8d" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:47:19.663549 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:47:19.663209 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:47:19.663880 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:47:19.663854 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-gsz5v" podUID="3f5309f4-e8bc-411f-81dc-fc842320ce8d" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 13:47:49.664421 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:47:49.664389 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gsz5v" Jun 05 13:49:05.644184 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:05.644143 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84d8b9cc64-fb76v"] Jun 05 13:49:05.644750 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:05.644363 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" podUID="8dba71a0-e94c-47ab-9311-bddd307f8097" containerName="manager" containerID="cri-o://ba3e2a3642a9cb0ef35cf1cb49585cb7e3e4da80d760a6f1e705fd8196acaff5" gracePeriod=30 Jun 05 13:49:05.892467 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:05.892439 2565 generic.go:356] "Generic (PLEG): container finished" podID="8dba71a0-e94c-47ab-9311-bddd307f8097" containerID="ba3e2a3642a9cb0ef35cf1cb49585cb7e3e4da80d760a6f1e705fd8196acaff5" exitCode=0 Jun 05 13:49:05.892598 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:05.892508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" event={"ID":"8dba71a0-e94c-47ab-9311-bddd307f8097","Type":"ContainerDied","Data":"ba3e2a3642a9cb0ef35cf1cb49585cb7e3e4da80d760a6f1e705fd8196acaff5"} Jun 05 13:49:05.911379 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:05.911355 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:49:06.015994 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.015963 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dba71a0-e94c-47ab-9311-bddd307f8097-webhook-cert\") pod \"8dba71a0-e94c-47ab-9311-bddd307f8097\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " Jun 05 13:49:06.016188 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.016151 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhh8j\" (UniqueName: \"kubernetes.io/projected/8dba71a0-e94c-47ab-9311-bddd307f8097-kube-api-access-jhh8j\") pod \"8dba71a0-e94c-47ab-9311-bddd307f8097\" (UID: \"8dba71a0-e94c-47ab-9311-bddd307f8097\") " Jun 05 13:49:06.018094 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.018062 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8dba71a0-e94c-47ab-9311-bddd307f8097-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8dba71a0-e94c-47ab-9311-bddd307f8097" (UID: "8dba71a0-e94c-47ab-9311-bddd307f8097"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 13:49:06.018213 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.018155 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dba71a0-e94c-47ab-9311-bddd307f8097-kube-api-access-jhh8j" (OuterVolumeSpecName: "kube-api-access-jhh8j") pod "8dba71a0-e94c-47ab-9311-bddd307f8097" (UID: "8dba71a0-e94c-47ab-9311-bddd307f8097"). InnerVolumeSpecName "kube-api-access-jhh8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 13:49:06.117543 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.117513 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhh8j\" (UniqueName: \"kubernetes.io/projected/8dba71a0-e94c-47ab-9311-bddd307f8097-kube-api-access-jhh8j\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:49:06.117543 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.117539 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dba71a0-e94c-47ab-9311-bddd307f8097-webhook-cert\") on node \"ip-10-0-142-213.ec2.internal\" DevicePath \"\"" Jun 05 13:49:06.898687 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.898659 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" Jun 05 13:49:06.899117 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.898698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84d8b9cc64-fb76v" event={"ID":"8dba71a0-e94c-47ab-9311-bddd307f8097","Type":"ContainerDied","Data":"c5f07effe76448b785a88cd5d22a6262135d1d14d0aaa2a2e3d9820b606f29c4"} Jun 05 13:49:06.899117 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.898759 2565 scope.go:117] "RemoveContainer" containerID="ba3e2a3642a9cb0ef35cf1cb49585cb7e3e4da80d760a6f1e705fd8196acaff5" Jun 05 13:49:06.921532 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.921506 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84d8b9cc64-fb76v"] Jun 05 13:49:06.927536 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:06.927515 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84d8b9cc64-fb76v"] Jun 05 13:49:07.465382 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:07.465346 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dba71a0-e94c-47ab-9311-bddd307f8097" path="/var/lib/kubelet/pods/8dba71a0-e94c-47ab-9311-bddd307f8097/volumes" Jun 05 13:49:22.032409 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:22.032379 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:49:22.035820 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:22.035795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:49:22.040899 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:22.040878 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:49:22.043812 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:49:22.043795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:54:22.065947 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:54:22.065919 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:54:22.071157 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:54:22.071136 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:54:22.074507 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:54:22.074488 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:54:22.079088 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:54:22.079070 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:59:22.104493 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:59:22.104466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:59:22.111059 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:59:22.111018 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 13:59:22.113215 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:59:22.113181 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 13:59:22.119305 ip-10-0-142-213 kubenswrapper[2565]: I0605 13:59:22.119286 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 14:04:22.137423 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:04:22.137395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 14:04:22.145270 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:04:22.145247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 14:04:22.147033 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:04:22.147017 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 14:04:22.154573 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:04:22.154556 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 14:09:22.174685 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:09:22.174659 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 14:09:22.182745 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:09:22.182721 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 14:09:22.183233 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:09:22.183211 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 14:09:22.191257 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:09:22.191234 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-ip-10-0-142-213.ec2.internal_465118258f8bb9795084833298745874/kube-rbac-proxy-crio/0.log" Jun 05 14:10:41.013169 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:41.013138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-75f4c87df8-f78xl_84eef86a-923e-45da-90b6-96607c1a604b/nginx/0.log" Jun 05 14:10:41.469683 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:41.469650 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d675c6b48-7c6tm_676f6b61-beb4-478f-872c-a679bd95f6ae/maas-api/0.log" Jun 05 14:10:42.285547 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:42.285513 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72_bb04e35b-1bdc-4e5d-a2ed-6a905579209b/copy-manifests/0.log" Jun 05 14:10:42.292356 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:42.292331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72_bb04e35b-1bdc-4e5d-a2ed-6a905579209b/manager/0.log" Jun 05 14:10:42.540238 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:42.540145 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-zbk2q_c5164cb5-2ff5-4008-8e42-12cc6f9e3699/postgres/0.log" Jun 05 14:10:43.917484 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:43.917451 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5r6sj_c38c34e5-277d-424c-b276-6d42cd577786/manager/0.log" Jun 05 14:10:44.025938 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:44.025907 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vgfjd_71d642d5-20de-4314-9863-877398ce292a/manager/0.log" Jun 05 14:10:44.257259 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:44.257231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gn22q_ddc1bcdb-2e6a-4471-8108-ff30d8c80d24/registry-server/0.log" Jun 05 14:10:44.626953 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:44.626860 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-58btb_2f2f1119-6607-413f-aa05-f338d347a848/manager/0.log" Jun 05 14:10:44.977535 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:44.977508 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rbscc_0f2a2c1b-da53-4e2b-80d9-82333a311712/istio-proxy/0.log" Jun 05 14:10:45.431869 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:45.431782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/1.log" Jun 05 14:10:45.547481 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:45.547454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-czvd9_d9635ce0-2b41-4cf7-848e-01ae0e7ca08b/payload-pre-processing/0.log" Jun 05 14:10:45.662607 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:45.662575 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6bt44_244b70ad-0825-46dd-a74e-67e649421f60/payload-processing/0.log" Jun 05 14:10:46.127302 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.127251 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j_bc8fa722-5c21-4352-9817-8b759179ace9/storage-initializer/0.log" Jun 05 14:10:46.134923 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.134900 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-zms6j_bc8fa722-5c21-4352-9817-8b759179ace9/main/0.log" Jun 05 14:10:46.248688 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.248660 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2thwn_e060b2d9-89c5-4a63-893e-97b06bf52dcf/storage-initializer/0.log" Jun 05 14:10:46.255479 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.255438 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-2thwn_e060b2d9-89c5-4a63-893e-97b06bf52dcf/main/0.log" Jun 05 14:10:46.363424 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.363389 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s_1e28dee6-ee82-499f-9c75-190f2cfeb508/storage-initializer/0.log" Jun 05 14:10:46.370189 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.370167 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-ghp6s_1e28dee6-ee82-499f-9c75-190f2cfeb508/main/0.log" Jun 05 14:10:46.706985 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.706950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bp5rh_45be97b3-76e3-4d6f-8782-da19c433bec4/storage-initializer/0.log" Jun 05 14:10:46.714164 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:46.714138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bp5rh_45be97b3-76e3-4d6f-8782-da19c433bec4/main/0.log" Jun 05 14:10:53.266789 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:53.266755 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2xjfw_bec4494e-a2eb-4c16-bd6b-56586ced9c9a/global-pull-secret-syncer/0.log" Jun 05 14:10:53.447079 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:53.447025 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gsz5v_3f5309f4-e8bc-411f-81dc-fc842320ce8d/konnectivity-agent/0.log" Jun 05 14:10:53.513770 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:53.513744 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-213.ec2.internal_9405462326c3d03704d40b0e557af439/haproxy/0.log" Jun 05 14:10:58.504984 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:58.504950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-5r6sj_c38c34e5-277d-424c-b276-6d42cd577786/manager/0.log" Jun 05 14:10:58.536794 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:58.536764 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vgfjd_71d642d5-20de-4314-9863-877398ce292a/manager/0.log" Jun 05 14:10:58.608317 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:58.608287 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gn22q_ddc1bcdb-2e6a-4471-8108-ff30d8c80d24/registry-server/0.log" Jun 05 14:10:58.757229 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:10:58.757127 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-58btb_2f2f1119-6607-413f-aa05-f338d347a848/manager/0.log" Jun 05 14:11:00.297173 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.297144 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/alertmanager/0.log" Jun 05 14:11:00.318561 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.318539 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/config-reloader/0.log" Jun 05 14:11:00.338683 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.338657 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/kube-rbac-proxy-web/0.log" Jun 05 14:11:00.364755 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.364724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/kube-rbac-proxy/0.log" Jun 05 14:11:00.386158 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.386135 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/kube-rbac-proxy-metric/0.log" Jun 05 14:11:00.407120 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.407091 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/prom-label-proxy/0.log" Jun 05 14:11:00.427610 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.427567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_880deafa-f1fa-4f06-8042-b48cf3b99778/init-config-reloader/0.log" Jun 05 14:11:00.469845 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.469820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-4lltc_e765b3f4-cf59-4e58-bf2b-195f98feaed0/cluster-monitoring-operator/0.log" Jun 05 14:11:00.602843 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.602810 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-6dxpk_6872bf60-dcf1-41b7-9c39-1632eab7ada3/monitoring-plugin/0.log" Jun 05 14:11:00.633795 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.633767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9pcpq_38e54643-4368-4aed-bb07-d0872f47162d/node-exporter/0.log" Jun 05 14:11:00.654081 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.654006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9pcpq_38e54643-4368-4aed-bb07-d0872f47162d/kube-rbac-proxy/0.log" Jun 05 14:11:00.673379 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.673347 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9pcpq_38e54643-4368-4aed-bb07-d0872f47162d/init-textfile/0.log" Jun 05 14:11:00.987281 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:00.987252 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/prometheus/0.log" Jun 05 14:11:01.017131 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.017102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/config-reloader/0.log" Jun 05 14:11:01.037599 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.037567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/thanos-sidecar/0.log" Jun 05 14:11:01.056734 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.056701 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/kube-rbac-proxy-web/0.log" Jun 05 14:11:01.076836 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.076813 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/kube-rbac-proxy/0.log" Jun 05 14:11:01.097811 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.097787 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/kube-rbac-proxy-thanos/0.log" Jun 05 14:11:01.139441 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.139416 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4c654c2d-ff0f-4571-a572-48f70ad39498/init-config-reloader/0.log" Jun 05 14:11:01.175086 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.174995 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-62sd4_da4ff8c5-eea6-45ff-b10c-09470c491baa/prometheus-operator/0.log" Jun 05 14:11:01.197713 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.197688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-62sd4_da4ff8c5-eea6-45ff-b10c-09470c491baa/kube-rbac-proxy/0.log" Jun 05 14:11:01.259755 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.259725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ddcddc999-bcwvx_a299ebac-4316-40f8-8ce1-1f16d4c250a9/telemeter-client/0.log" Jun 05 14:11:01.286101 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.286072 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ddcddc999-bcwvx_a299ebac-4316-40f8-8ce1-1f16d4c250a9/reload/0.log" Jun 05 14:11:01.307991 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:01.307967 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ddcddc999-bcwvx_a299ebac-4316-40f8-8ce1-1f16d4c250a9/kube-rbac-proxy/0.log" Jun 05 14:11:03.672672 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:03.672641 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/2.log" Jun 05 14:11:03.682632 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:03.682606 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-c8x6s_ff312463-178f-43ba-91b9-de02fdca5fe2/console-operator/3.log" Jun 05 14:11:06.310721 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.310687 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc"] Jun 05 14:11:06.311440 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.311414 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dba71a0-e94c-47ab-9311-bddd307f8097" containerName="manager" Jun 05 14:11:06.311440 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.311439 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dba71a0-e94c-47ab-9311-bddd307f8097" containerName="manager" Jun 05 14:11:06.311620 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.311550 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dba71a0-e94c-47ab-9311-bddd307f8097" containerName="manager" Jun 05 14:11:06.315011 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.314990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.317467 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.317447 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2ttzs\"/\"kube-root-ca.crt\"" Jun 05 14:11:06.318427 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.318411 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2ttzs\"/\"default-dockercfg-mgz62\"" Jun 05 14:11:06.318427 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.318421 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2ttzs\"/\"openshift-service-ca.crt\"" Jun 05 14:11:06.325674 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.325651 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc"] Jun 05 14:11:06.376002 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.375974 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvmzq_b9472347-824d-43fe-b6a1-b53685f25aa0/dns/0.log" Jun 05 14:11:06.415551 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.415514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-sys\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.415783 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.415601 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-podres\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.415783 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.415609 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvmzq_b9472347-824d-43fe-b6a1-b53685f25aa0/kube-rbac-proxy/0.log" Jun 05 14:11:06.415783 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.415655 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-proc\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.415783 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.415704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpzmx\" (UniqueName: \"kubernetes.io/projected/fbc68fe5-0bd0-405e-813d-86eaddd920fe-kube-api-access-tpzmx\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.415962 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.415811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-lib-modules\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.490488 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.490459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8gbk_36e7f949-4ced-4d2c-ba2e-7e9d319488ac/dns-node-resolver/0.log" Jun 05 14:11:06.516460 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-proc\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516620 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpzmx\" (UniqueName: \"kubernetes.io/projected/fbc68fe5-0bd0-405e-813d-86eaddd920fe-kube-api-access-tpzmx\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516620 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-lib-modules\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516620 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-sys\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516620 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516554 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-proc\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516620 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-sys\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516827 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-podres\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516827 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516683 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-lib-modules\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.516827 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.516792 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fbc68fe5-0bd0-405e-813d-86eaddd920fe-podres\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.524212 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.524180 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpzmx\" (UniqueName: \"kubernetes.io/projected/fbc68fe5-0bd0-405e-813d-86eaddd920fe-kube-api-access-tpzmx\") pod \"perf-node-gather-daemonset-sjljc\" (UID: \"fbc68fe5-0bd0-405e-813d-86eaddd920fe\") " pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.626033 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.625951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:06.760546 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.760522 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc"] Jun 05 14:11:06.762205 ip-10-0-142-213 kubenswrapper[2565]: W0605 14:11:06.762178 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfbc68fe5_0bd0_405e_813d_86eaddd920fe.slice/crio-7276d98db6877ed1ccc4f57e3ae018ecb459389af4921a69035bc30dfdae4d28 WatchSource:0}: Error finding container 7276d98db6877ed1ccc4f57e3ae018ecb459389af4921a69035bc30dfdae4d28: Status 404 returned error can't find the container with id 7276d98db6877ed1ccc4f57e3ae018ecb459389af4921a69035bc30dfdae4d28 Jun 05 14:11:06.802164 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:06.802139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" event={"ID":"fbc68fe5-0bd0-405e-813d-86eaddd920fe","Type":"ContainerStarted","Data":"7276d98db6877ed1ccc4f57e3ae018ecb459389af4921a69035bc30dfdae4d28"} Jun 05 14:11:07.166459 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:07.166375 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wm82f_00848e40-2fdf-4321-a336-e8363b12c652/node-ca/0.log" Jun 05 14:11:07.809164 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:07.809125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" event={"ID":"fbc68fe5-0bd0-405e-813d-86eaddd920fe","Type":"ContainerStarted","Data":"5899ffc0088b9929a8dbbfb94d2d910aec1ff430aa0fe46de0c5212e72faf88c"} Jun 05 14:11:07.809615 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:07.809203 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:07.824344 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:07.824292 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" podStartSLOduration=1.8242707889999998 podStartE2EDuration="1.824270789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:11:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:07.824266387 +0000 UTC m=+2806.768560697" watchObservedRunningTime="2026-06-05 14:11:07.824270789 +0000 UTC m=+2806.768565100" Jun 05 14:11:08.136997 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:08.136913 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rbscc_0f2a2c1b-da53-4e2b-80d9-82333a311712/istio-proxy/0.log" Jun 05 14:11:08.378077 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:08.378027 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/0.log" Jun 05 14:11:08.408680 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:08.408599 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/1.log" Jun 05 14:11:08.471302 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:08.471258 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-czvd9_d9635ce0-2b41-4cf7-848e-01ae0e7ca08b/payload-pre-processing/0.log" Jun 05 14:11:08.532009 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:08.531978 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6bt44_244b70ad-0825-46dd-a74e-67e649421f60/payload-processing/0.log" Jun 05 14:11:09.283681 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:09.283650 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p89jk_66c3cf0f-dab9-458a-b4e6-4617d28196e6/serve-healthcheck-canary/0.log" Jun 05 14:11:09.801153 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:09.801116 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-kp4xl_de1a44ff-8385-42ff-9354-4afd1be39b12/insights-operator/0.log" Jun 05 14:11:09.802489 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:09.802468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-kp4xl_de1a44ff-8385-42ff-9354-4afd1be39b12/insights-operator/1.log" Jun 05 14:11:09.838196 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:09.838170 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jgh4s_b428c4ce-3562-451a-8de5-77503c908278/kube-rbac-proxy/0.log" Jun 05 14:11:09.880225 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:09.880197 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jgh4s_b428c4ce-3562-451a-8de5-77503c908278/exporter/0.log" Jun 05 14:11:09.914990 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:09.914959 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jgh4s_b428c4ce-3562-451a-8de5-77503c908278/extractor/0.log" Jun 05 14:11:12.325531 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:12.325498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-75f4c87df8-f78xl_84eef86a-923e-45da-90b6-96607c1a604b/nginx/0.log" Jun 05 14:11:12.478370 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:12.478341 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d675c6b48-7c6tm_676f6b61-beb4-478f-872c-a679bd95f6ae/maas-api/0.log" Jun 05 14:11:12.732969 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:12.732944 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72_bb04e35b-1bdc-4e5d-a2ed-6a905579209b/manager/0.log" Jun 05 14:11:12.753390 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:12.753366 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bbdbf4cc8-k8h72_bb04e35b-1bdc-4e5d-a2ed-6a905579209b/copy-manifests/0.log" Jun 05 14:11:12.900269 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:12.900242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-zbk2q_c5164cb5-2ff5-4008-8e42-12cc6f9e3699/postgres/0.log" Jun 05 14:11:13.823302 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:13.823274 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2ttzs/perf-node-gather-daemonset-sjljc" Jun 05 14:11:14.413314 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:14.413288 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-686f455b98-p95hb_79541f28-eafb-4f37-97f5-ac03fc80914b/manager/0.log" Jun 05 14:11:19.970899 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:19.970873 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rbscc_0f2a2c1b-da53-4e2b-80d9-82333a311712/istio-proxy/0.log" Jun 05 14:11:20.096974 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:20.096936 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/0.log" Jun 05 14:11:20.133528 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:20.133497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/1.log" Jun 05 14:11:20.168162 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:20.168133 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-czvd9_d9635ce0-2b41-4cf7-848e-01ae0e7ca08b/payload-pre-processing/0.log" Jun 05 14:11:20.219743 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:20.219717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6bt44_244b70ad-0825-46dd-a74e-67e649421f60/payload-processing/0.log" Jun 05 14:11:21.493148 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.493120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rbscc_0f2a2c1b-da53-4e2b-80d9-82333a311712/istio-proxy/0.log" Jun 05 14:11:21.623175 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.623147 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/0.log" Jun 05 14:11:21.654961 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.654922 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2prgt_f96183bd-6921-4969-94c9-a16849fcc848/kube-multus/0.log" Jun 05 14:11:21.656848 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.656820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/1.log" Jun 05 14:11:21.696374 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.696348 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-czvd9_d9635ce0-2b41-4cf7-848e-01ae0e7ca08b/payload-pre-processing/0.log" Jun 05 14:11:21.747975 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.747902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6bt44_244b70ad-0825-46dd-a74e-67e649421f60/payload-processing/0.log" Jun 05 14:11:21.870316 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.870286 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/kube-multus-additional-cni-plugins/0.log" Jun 05 14:11:21.890495 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.890465 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/egress-router-binary-copy/0.log" Jun 05 14:11:21.911673 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.911645 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/cni-plugins/0.log" Jun 05 14:11:21.931020 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.930996 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/bond-cni-plugin/0.log" Jun 05 14:11:21.950978 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.950956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/routeoverride-cni/0.log" Jun 05 14:11:21.971385 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.971361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/whereabouts-cni-bincopy/0.log" Jun 05 14:11:21.990895 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:21.990860 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m8f7d_195a2f0b-8156-45fa-802f-c31fe869e706/whereabouts-cni/0.log" Jun 05 14:11:22.281029 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:22.281002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wbcds_b1f6139d-854e-43a5-ab53-4c0689e9abe3/network-metrics-daemon/0.log" Jun 05 14:11:22.300686 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:22.300652 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wbcds_b1f6139d-854e-43a5-ab53-4c0689e9abe3/kube-rbac-proxy/0.log" Jun 05 14:11:23.452921 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.452882 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rbscc_0f2a2c1b-da53-4e2b-80d9-82333a311712/istio-proxy/0.log" Jun 05 14:11:23.580718 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.580675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/0.log" Jun 05 14:11:23.613742 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.613714 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-v5kvz_161b9951-a0f4-40d2-bb77-c162bc4be92b/istio-proxy/1.log" Jun 05 14:11:23.648931 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.648901 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-czvd9_d9635ce0-2b41-4cf7-848e-01ae0e7ca08b/payload-pre-processing/0.log" Jun 05 14:11:23.676601 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.676576 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/ovn-controller/0.log" Jun 05 14:11:23.694194 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.694158 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/ovn-acl-logging/0.log" Jun 05 14:11:23.703110 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.703017 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-6bt44_244b70ad-0825-46dd-a74e-67e649421f60/payload-processing/0.log" Jun 05 14:11:23.718746 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.718726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/kube-rbac-proxy-node/0.log" Jun 05 14:11:23.739829 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.739803 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 14:11:23.758115 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.758093 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/northd/0.log" Jun 05 14:11:23.780494 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.780472 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/nbdb/0.log" Jun 05 14:11:23.801546 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.801526 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/sbdb/0.log" Jun 05 14:11:23.845850 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:23.845827 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gkxkz_bfb2ef31-70ea-424d-a920-baed0b742420/ovnkube-controller/0.log" Jun 05 14:11:25.212557 ip-10-0-142-213 kubenswrapper[2565]: I0605 14:11:25.212530 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-prc6s_8e95feff-2a72-449a-ae49-708b67812bf9/network-check-target-container/0.log"