Jun 02 01:56:30.361932 ip-10-0-131-106 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:56:30.876710 ip-10-0-131-106 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:56:30.876710 ip-10-0-131-106 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:56:30.876710 ip-10-0-131-106 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:56:30.876710 ip-10-0-131-106 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:56:30.876710 ip-10-0-131-106 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:56:30.878763 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.878679 2579 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:56:30.881703 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881685 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:56:30.881703 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881701 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:56:30.881703 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881706 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881710 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881715 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881719 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881722 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881726 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881730 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881734 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881738 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881742 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881746 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881749 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881753 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881757 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881760 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881764 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881768 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881771 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881778 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881783 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:56:30.881896 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881787 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881791 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881799 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881804 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881808 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881811 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881816 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881820 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881824 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881828 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881832 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881836 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881840 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881844 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881850 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881854 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881858 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881863 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881867 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881871 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:56:30.882740 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881875 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881879 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881883 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881888 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881892 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881895 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881900 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881903 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881908 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881912 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881917 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881920 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881924 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881928 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881936 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881942 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881947 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881951 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881955 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:56:30.883582 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881959 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881963 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881968 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881972 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881976 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881981 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881986 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881991 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881995 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.881999 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882003 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882008 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882012 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882018 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882024 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882028 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882032 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882038 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882044 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:56:30.884397 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882048 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882053 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882057 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882061 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882065 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882079 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882724 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882733 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882738 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882742 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882746 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882751 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882756 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882760 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882764 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882768 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882772 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882776 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882780 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882785 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:56:30.885028 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882789 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882794 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882798 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882802 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882806 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882810 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882814 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882820 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882824 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882836 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882840 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882844 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882848 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882853 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882857 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882861 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882865 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882869 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882873 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:56:30.885587 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882877 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882881 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882885 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882890 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882894 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882898 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882902 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882906 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882910 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882914 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882921 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882927 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882935 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882941 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882945 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882949 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882954 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882958 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882962 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882967 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:56:30.886246 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882971 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882976 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882980 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882985 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882990 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882994 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.882998 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883002 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883007 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883011 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883015 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883019 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883026 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883032 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883036 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883042 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883046 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883051 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883056 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:56:30.886748 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883060 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883066 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883071 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883075 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883079 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883083 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883088 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883092 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883096 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883101 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883105 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883110 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883114 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.883118 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883212 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883225 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883234 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883240 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883247 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883252 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883258 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:56:30.887313 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883265 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883271 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883276 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883281 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883286 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883291 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883296 2579 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883301 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883306 2579 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883311 2579 flags.go:64] FLAG: --cloud-config="" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883316 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883320 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883328 2579 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883332 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883337 2579 flags.go:64] FLAG: --config-dir="" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883342 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883348 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883354 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883359 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883364 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883370 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883374 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883379 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883384 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883389 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:56:30.887843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883394 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883401 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883406 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883411 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883416 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883421 2579 flags.go:64] FLAG: --enable-server="true" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883425 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883432 2579 flags.go:64] FLAG: --event-burst="100" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883436 2579 flags.go:64] FLAG: --event-qps="50" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883441 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883447 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883452 2579 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883458 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883462 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883467 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883472 2579 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883477 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883482 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883487 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883492 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883497 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883501 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883505 2579 flags.go:64] FLAG: --feature-gates="" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883512 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883517 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:56:30.888452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883523 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883528 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883533 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883538 2579 flags.go:64] FLAG: --help="false" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883543 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-131-106.ec2.internal" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883549 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883554 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883559 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883565 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883571 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883576 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883581 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883585 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883590 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883594 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883599 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883604 2579 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883613 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883618 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883623 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883627 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883632 2579 flags.go:64] FLAG: --lock-file="" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883637 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883642 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:56:30.889134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883646 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883655 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883679 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883684 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883688 2579 flags.go:64] FLAG: --logging-format="text" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883693 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883699 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883704 2579 flags.go:64] FLAG: --manifest-url="" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883708 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883715 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883721 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883727 2579 flags.go:64] FLAG: --max-pods="110" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883732 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883738 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883743 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883747 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883752 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883756 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883761 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883774 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883779 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883783 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883788 2579 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:56:30.889732 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883792 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883801 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883806 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883813 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883817 2579 flags.go:64] FLAG: --port="10250" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883822 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883827 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0451fd8a7d720f750" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883832 2579 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883837 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883842 2579 flags.go:64] FLAG: --register-node="true" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883847 2579 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883851 2579 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883857 2579 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883862 2579 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883866 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883873 2579 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883879 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883884 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883889 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883894 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883899 2579 flags.go:64] FLAG: --runonce="false" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883904 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883909 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883913 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883918 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883923 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:56:30.890331 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883928 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883934 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883939 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883944 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883949 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883953 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883958 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883963 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883968 2579 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883974 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883983 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883987 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883992 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.883998 2579 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884003 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884008 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884013 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884017 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884022 2579 flags.go:64] FLAG: --v="2" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884029 2579 flags.go:64] FLAG: --version="false" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884035 2579 flags.go:64] FLAG: --vmodule="" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884043 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884049 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884189 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:56:30.890973 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884195 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884200 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884205 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884210 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884215 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884219 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884224 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884228 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884232 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884237 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884241 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884245 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884255 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884259 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884263 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884268 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884272 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884280 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884286 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:56:30.891564 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884290 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884294 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884298 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884302 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884307 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884311 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884315 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884320 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884324 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884328 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884333 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884337 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884342 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884346 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884350 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884354 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884359 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884363 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884367 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:56:30.892058 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884371 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884376 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884380 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884384 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884388 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884392 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884396 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884401 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884405 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884409 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884413 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884418 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884422 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884428 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884434 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884439 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884444 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884449 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884454 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:56:30.892522 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884458 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884462 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884466 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884471 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884477 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884481 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884485 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884489 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884493 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884498 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884502 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884506 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884510 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884515 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884519 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884523 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884527 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884532 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884536 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884540 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:56:30.893001 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884544 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884548 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884553 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884557 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884561 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884566 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884570 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.884574 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.884582 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.891566 2579 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.891581 2579 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891628 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891633 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891637 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891640 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891643 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:56:30.893472 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891646 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891649 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891652 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891655 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891657 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891679 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891681 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891684 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891686 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891690 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891693 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891695 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891698 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891701 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891703 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891706 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891709 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891712 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891715 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891718 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:56:30.893901 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891720 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891723 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891725 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891728 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891730 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891733 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891736 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891739 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891741 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891744 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891746 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891749 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891751 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891754 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891756 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891759 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891761 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891764 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891768 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:56:30.894375 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891772 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891775 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891777 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891780 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891783 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891785 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891788 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891791 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891794 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891797 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891799 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891803 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891806 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891808 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891811 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891814 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891816 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891819 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891821 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891824 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:56:30.894867 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891827 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891829 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891832 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891834 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891837 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891839 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891842 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891844 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891847 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891849 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891852 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891854 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891856 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891859 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891861 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891864 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891867 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891870 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891873 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891875 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:56:30.895356 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891878 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891880 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.891885 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891975 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891980 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891983 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891985 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891988 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891991 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891993 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891996 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.891999 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892002 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892004 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892007 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:56:30.895856 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892009 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892012 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892014 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892017 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892019 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892022 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892024 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892027 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892031 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892034 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892037 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892040 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892043 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892046 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892048 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892051 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892053 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892056 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892058 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:56:30.896221 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892061 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892063 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892066 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892069 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892071 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892074 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892076 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892079 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892082 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892085 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892087 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892090 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892092 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892095 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892097 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892099 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892102 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892104 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892106 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892109 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:56:30.896689 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892111 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892113 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892116 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892118 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892121 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892123 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892125 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892128 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892130 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892132 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892135 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892137 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892139 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892142 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892144 2579 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892147 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892150 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892152 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892154 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892157 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:56:30.897173 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892159 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892162 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892165 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892167 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892169 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892172 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892174 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892178 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892181 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892184 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892186 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892189 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892191 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892194 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:30.892196 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.892201 2579 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:56:30.897672 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.893096 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:56:30.899016 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.898997 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:56:30.900172 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.900161 2579 server.go:1019] "Starting client certificate rotation" Jun 02 01:56:30.900281 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.900263 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:56:30.900316 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.900300 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:56:30.930229 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.930212 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:56:30.943848 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.943827 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:56:30.956888 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.956865 2579 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:56:30.962889 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.962870 2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:56:30.963887 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.963873 2579 log.go:25] "Validated CRI v1 image API" Jun 02 01:56:30.965341 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.965325 2579 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:56:30.970764 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.970739 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e3da9b8d-b804-4906-b669-29491c7c3c8f:/dev/nvme0n1p3 fcb51301-979b-4d87-bba7-d7508fb29f54:/dev/nvme0n1p4] Jun 02 01:56:30.970823 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.970764 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:56:30.974977 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.974870 2579 manager.go:217] Machine: {Timestamp:2026-06-02 01:56:30.974356492 +0000 UTC m=+0.473900156 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104468 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d69fc14fe8243d1baf15d1f6be435 SystemUUID:ec2d69fc-14fe-8243-d1ba-f15d1f6be435 BootID:a00b388f-aa03-4796-9ec8-750b3a0d1600 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:e8:df:a8:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:e8:df:a8:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:c6:80:d8:52:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:56:30.975771 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.975760 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:56:30.975846 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.975835 2579 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:56:30.977996 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.977968 2579 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:56:30.978209 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.978000 2579 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-106.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:56:30.978296 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.978222 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:56:30.978296 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.978234 2579 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:56:30.978296 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.978244 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:56:30.978296 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.978267 2579 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:56:30.979886 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.979873 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:56:30.980160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.980147 2579 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:56:30.982782 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.982770 2579 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:56:30.982863 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.982788 2579 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:56:30.982863 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.982805 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:56:30.982863 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.982820 2579 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:56:30.982863 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.982851 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:56:30.984129 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.984107 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:56:30.984202 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.984140 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:56:30.987581 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.987563 2579 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:56:30.988939 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.988924 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pk887" Jun 02 01:56:30.989877 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.989864 2579 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:56:30.992928 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992914 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992934 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992940 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992946 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992955 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992961 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992966 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:56:30.992972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992972 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:56:30.993152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992980 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:56:30.993152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992986 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:56:30.993152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.992995 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:56:30.993152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.993000 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:56:30.994003 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.993992 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:56:30.994003 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.994003 2579 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:56:30.994425 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.994409 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pk887" Jun 02 01:56:30.997239 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.997226 2579 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:56:30.997333 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.997263 2579 server.go:1295] "Started kubelet" Jun 02 01:56:30.997333 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.997320 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:56:30.998063 ip-10-0-131-106 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:56:30.999612 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.997447 2579 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:56:30.999718 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:30.999680 2579 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:56:31.001888 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.001869 2579 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:56:31.002339 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.002321 2579 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:56:31.006910 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.006884 2579 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:31.009015 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.008999 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:56:31.009119 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009022 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:56:31.009181 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009162 2579 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:56:31.009181 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009174 2579 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:56:31.009278 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009256 2579 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:56:31.009328 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009313 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:56:31.009328 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009321 2579 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:56:31.009504 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009485 2579 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:31.009905 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009889 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:56:31.009905 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009904 2579 factory.go:55] Registering systemd factory Jun 02 01:56:31.010009 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.009910 2579 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:56:31.010052 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.010012 2579 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-131-106.ec2.internal\" not found" Jun 02 01:56:31.010166 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.010155 2579 factory.go:153] Registering CRI-O factory Jun 02 01:56:31.010220 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.010169 2579 factory.go:223] Registration of the crio container factory successfully Jun 02 01:56:31.010220 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.010183 2579 factory.go:103] Registering Raw factory Jun 02 01:56:31.010220 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.010192 2579 manager.go:1196] Started watching for new ooms in manager Jun 02 01:56:31.010545 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.010527 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-106.ec2.internal" not found Jun 02 01:56:31.011323 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.011306 2579 manager.go:319] Starting recovery of all containers Jun 02 01:56:31.012091 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.012064 2579 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:56:31.012364 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.012344 2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:31.016520 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.016365 2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-106.ec2.internal\" not found" node="ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.017952 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.017911 2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:56:31.022719 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.022704 2579 manager.go:324] Recovery completed Jun 02 01:56:31.027479 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.027463 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-106.ec2.internal" not found Jun 02 01:56:31.028447 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.028425 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:56:31.030914 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.030900 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:56:31.030990 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.030928 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:56:31.030990 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.030938 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:56:31.031470 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.031457 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:56:31.031470 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.031469 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:56:31.031553 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.031485 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:56:31.035081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.035069 2579 policy_none.go:49] "None policy: Start" Jun 02 01:56:31.035134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.035086 2579 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:56:31.035134 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.035096 2579 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:56:31.078201 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078185 2579 manager.go:341] "Starting Device Plugin manager" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.078222 2579 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078232 2579 server.go:85] "Starting device plugin registration server" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078490 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078503 2579 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078592 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078679 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.078689 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.079195 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.079230 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-106.ec2.internal\" not found" Jun 02 01:56:31.092674 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.086526 2579 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-131-106.ec2.internal" not found Jun 02 01:56:31.101898 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.101881 2579 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:56:31.101974 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.101908 2579 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:56:31.101974 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.101923 2579 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:56:31.101974 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.101931 2579 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:56:31.101974 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.101961 2579 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:56:31.104403 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.104387 2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:31.178821 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.178730 2579 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:56:31.180226 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.180210 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:56:31.180307 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.180241 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:56:31.180307 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.180254 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:56:31.180307 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.180277 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.190568 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.190550 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.202588 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.202554 2579 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal"] Jun 02 01:56:31.204691 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.204678 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.204778 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.204681 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.209550 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.209528 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.235226 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.235207 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.239594 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.239580 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.300586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.300564 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:56:31.303410 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.303397 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:56:31.304726 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.304713 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:56:31.304769 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.304752 2579 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.304769 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.304764 2579 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.309678 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.309641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d3d24e025e3c6e3273d82141c242944-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"4d3d24e025e3c6e3273d82141c242944\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.309757 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.309682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d3d24e025e3c6e3273d82141c242944-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"4d3d24e025e3c6e3273d82141c242944\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.309757 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.309706 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23004b7e1a83c12f34e3d0929fcfb824-config\") pod \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" (UID: \"23004b7e1a83c12f34e3d0929fcfb824\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.319385 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.319367 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:56:31.319430 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:31.319402 2579 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.409809 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.409788 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d3d24e025e3c6e3273d82141c242944-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"4d3d24e025e3c6e3273d82141c242944\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.409946 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.409816 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23004b7e1a83c12f34e3d0929fcfb824-config\") pod \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" (UID: \"23004b7e1a83c12f34e3d0929fcfb824\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.409946 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.409834 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d3d24e025e3c6e3273d82141c242944-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"4d3d24e025e3c6e3273d82141c242944\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.409946 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.409886 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d3d24e025e3c6e3273d82141c242944-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"4d3d24e025e3c6e3273d82141c242944\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.409946 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.409891 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d3d24e025e3c6e3273d82141c242944-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal\" (UID: \"4d3d24e025e3c6e3273d82141c242944\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.409946 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.409892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23004b7e1a83c12f34e3d0929fcfb824-config\") pod \"kube-apiserver-proxy-ip-10-0-131-106.ec2.internal\" (UID: \"23004b7e1a83c12f34e3d0929fcfb824\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.603432 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.603398 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.606882 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.606860 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" Jun 02 01:56:31.900321 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.900246 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:56:31.900914 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.900406 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:56:31.900914 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.900393 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:56:31.900914 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.900419 2579 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:56:31.983902 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.983877 2579 apiserver.go:52] "Watching apiserver" Jun 02 01:56:31.992702 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.992286 2579 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:56:31.994630 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.994610 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-qs9z2","openshift-multus/network-metrics-daemon-gkmb5","openshift-network-operator/iptables-alerter-hk6z2","openshift-ovn-kubernetes/ovnkube-node-mbdtj","kube-system/konnectivity-agent-qn7sb","kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs","openshift-dns/node-resolver-tgzrg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal","openshift-multus/multus-additional-cni-plugins-tpbkk","openshift-multus/multus-q77rp","openshift-network-diagnostics/network-check-target-zbj67","openshift-cluster-node-tuning-operator/tuned-zgklx"] Jun 02 01:56:31.996625 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.996604 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:51:30 +0000 UTC" deadline="2028-02-21 20:09:24.252839338 +0000 UTC" Jun 02 01:56:31.996692 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.996626 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15114h12m52.256215864s" Jun 02 01:56:31.998728 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:31.998712 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.001189 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.001170 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.001265 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.001249 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.001265 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.001248 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:32.001701 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.001685 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.002023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.002002 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:56:32.002397 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.002249 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t79dz\"" Jun 02 01:56:32.002397 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.002326 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.004286 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.004075 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9fvg9\"" Jun 02 01:56:32.004286 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.004222 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.004286 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.004213 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.004441 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.004320 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:56:32.006597 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.006581 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.008790 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.008772 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6m48q\"" Jun 02 01:56:32.008954 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.008937 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:56:32.009028 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.009010 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.009082 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.009060 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.009172 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.009157 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:56:32.010148 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.010128 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:56:32.010245 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.010218 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.010293 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.010221 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:56:32.010361 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.010222 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:56:32.011451 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011429 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.011451 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011447 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.011596 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011574 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.011712 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011693 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-snq6d\"" Jun 02 01:56:32.011814 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011795 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/586b98f9-bf13-49c5-8566-3e6ca679886d-agent-certs\") pod \"konnectivity-agent-qn7sb\" (UID: \"586b98f9-bf13-49c5-8566-3e6ca679886d\") " pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.011899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03de92-1707-4347-9a1a-a8f9d499f853-tmp-dir\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.011899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-registration-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.012015 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011922 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e03de92-1707-4347-9a1a-a8f9d499f853-hosts-file\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.012015 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lcsj\" (UniqueName: \"kubernetes.io/projected/7bc0ef35-081a-4873-9207-121947a1ce06-kube-api-access-6lcsj\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.012015 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.011978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-systemd-units\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-env-overrides\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.012160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-systemd\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-log-socket\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012182 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1d91dba-ad25-46be-9e87-06b814da1abf-ovn-node-metrics-cert\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012190 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-run-netns\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/586b98f9-bf13-49c5-8566-3e6ca679886d-konnectivity-ca\") pod \"konnectivity-agent-qn7sb\" (UID: \"586b98f9-bf13-49c5-8566-3e6ca679886d\") " pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-socket-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bc0ef35-081a-4873-9207-121947a1ce06-host\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-slash\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-cni-bin\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-device-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012425 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:56:32.012466 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxp5x\" (UniqueName: \"kubernetes.io/projected/cdf1330a-11b7-4033-8172-68d338d12288-kube-api-access-nxp5x\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmg6j\" (UniqueName: \"kubernetes.io/projected/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-kube-api-access-lmg6j\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-var-lib-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-etc-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-cni-netd\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-ovnkube-config\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012618 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-kubelet\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-node-log\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-ovnkube-script-lib\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012705 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqv27\" (UniqueName: \"kubernetes.io/projected/e1d91dba-ad25-46be-9e87-06b814da1abf-kube-api-access-mqv27\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012727 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptrtd\" (UniqueName: \"kubernetes.io/projected/9e03de92-1707-4347-9a1a-a8f9d499f853-kube-api-access-ptrtd\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7bc0ef35-081a-4873-9207-121947a1ce06-serviceca\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb88d\" (UniqueName: \"kubernetes.io/projected/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-kube-api-access-mb88d\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-iptables-alerter-script\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012894 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-host-slash\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.013081 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-ovn\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013733 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.013733 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.012989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-sys-fs\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.015166 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.014309 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.015625 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.015605 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:56:32.015869 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.015849 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.015952 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.015897 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.016221 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.016200 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5xrff\"" Jun 02 01:56:32.016419 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.016403 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6xf72\"" Jun 02 01:56:32.016603 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.016587 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:56:32.016929 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.016893 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:56:32.017196 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.017182 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwp4t\"" Jun 02 01:56:32.017280 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.017207 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:56:32.017335 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.017304 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.017385 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.017360 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:56:32.018046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.018029 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.018650 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.018621 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.018774 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.018737 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:32.018876 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.018851 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:32.020927 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.020896 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l6rs2\"" Jun 02 01:56:32.020927 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.020916 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:56:32.021072 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.021057 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.021825 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.021807 2579 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:56:32.023591 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.023573 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:56:32.023681 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.023642 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pp2rm\"" Jun 02 01:56:32.023681 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.023642 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:56:32.044151 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.044125 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cvzb" Jun 02 01:56:32.053609 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.053592 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4cvzb" Jun 02 01:56:32.110626 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.110605 2579 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:56:32.113796 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.113882 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-kubelet\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.113882 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-sys\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.113882 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-os-release\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.113882 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113854 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-netns\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113891 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-cni-bin\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113939 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptrtd\" (UniqueName: \"kubernetes.io/projected/9e03de92-1707-4347-9a1a-a8f9d499f853-kube-api-access-ptrtd\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113958 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mb88d\" (UniqueName: \"kubernetes.io/projected/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-kube-api-access-mb88d\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113975 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-host-slash\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.113990 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-ovn\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114007 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysconfig\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.114046 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114041 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-host-slash\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114068 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-ovn\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-run\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114144 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b722g\" (UniqueName: \"kubernetes.io/projected/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-kube-api-access-b722g\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114180 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-cni-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114198 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/586b98f9-bf13-49c5-8566-3e6ca679886d-agent-certs\") pod \"konnectivity-agent-qn7sb\" (UID: \"586b98f9-bf13-49c5-8566-3e6ca679886d\") " pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5pt\" (UniqueName: \"kubernetes.io/projected/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-kube-api-access-8n5pt\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114245 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e03de92-1707-4347-9a1a-a8f9d499f853-hosts-file\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114265 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114280 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-env-overrides\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-cnibin\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-cni-binary-copy\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114375 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e03de92-1707-4347-9a1a-a8f9d499f853-hosts-file\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-daemon-config\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114482 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-systemd\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114485 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114506 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-run-netns\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-systemd\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114578 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/586b98f9-bf13-49c5-8566-3e6ca679886d-konnectivity-ca\") pod \"konnectivity-agent-qn7sb\" (UID: \"586b98f9-bf13-49c5-8566-3e6ca679886d\") " pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114641 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-systemd\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114646 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-run-netns\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-env-overrides\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114696 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114769 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmg6j\" (UniqueName: \"kubernetes.io/projected/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-kube-api-access-lmg6j\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114791 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-var-lib-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114808 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-ovnkube-script-lib\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114835 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqv27\" (UniqueName: \"kubernetes.io/projected/e1d91dba-ad25-46be-9e87-06b814da1abf-kube-api-access-mqv27\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-var-lib-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.114968 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114921 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-modprobe-d\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114950 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ada76d3-24f1-4a99-a924-c511d7681fce-tmp\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.114977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115008 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-kubelet\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115037 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-node-log\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysctl-d\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-tuned\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47fx6\" (UniqueName: \"kubernetes.io/projected/0ada76d3-24f1-4a99-a924-c511d7681fce-kube-api-access-47fx6\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-system-cni-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/586b98f9-bf13-49c5-8566-3e6ca679886d-konnectivity-ca\") pod \"konnectivity-agent-qn7sb\" (UID: \"586b98f9-bf13-49c5-8566-3e6ca679886d\") " pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-kubelet\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115162 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115205 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-node-log\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115220 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7bc0ef35-081a-4873-9207-121947a1ce06-serviceca\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115257 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-iptables-alerter-script\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115263 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-etc-selinux\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115301 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115446 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-var-lib-kubelet\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cnibin\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-hostroot\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115433 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115460 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-sys-fs\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115488 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysctl-conf\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-ovnkube-script-lib\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115538 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115547 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-run-ovn-kubernetes\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-os-release\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115606 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-sys-fs\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115608 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7bc0ef35-081a-4873-9207-121947a1ce06-serviceca\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115590 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-conf-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-etc-kubernetes\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115717 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03de92-1707-4347-9a1a-a8f9d499f853-tmp-dir\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-iptables-alerter-script\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115746 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-registration-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.115995 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115772 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6lcsj\" (UniqueName: \"kubernetes.io/projected/7bc0ef35-081a-4873-9207-121947a1ce06-kube-api-access-6lcsj\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115793 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-registration-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115795 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-systemd-units\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-host\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115869 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-systemd-units\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-k8s-cni-cncf-io\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115933 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-multus-certs\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e03de92-1707-4347-9a1a-a8f9d499f853-tmp-dir\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115963 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.115997 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116016 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-log-socket\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116032 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1d91dba-ad25-46be-9e87-06b814da1abf-ovn-node-metrics-cert\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116037 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-run-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-lib-modules\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.116016 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-socket-dir-parent\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116082 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-log-socket\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116098 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.116643 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-cni-multus\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.116158 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:56:32.616119827 +0000 UTC m=+2.115663472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116199 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-socket-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116228 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bc0ef35-081a-4873-9207-121947a1ce06-host\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116253 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-slash\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116293 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-cni-bin\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116305 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-socket-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116292 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7bc0ef35-081a-4873-9207-121947a1ce06-host\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116338 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-slash\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-kubernetes\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116378 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-cni-bin\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116399 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-device-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116426 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nxp5x\" (UniqueName: \"kubernetes.io/projected/cdf1330a-11b7-4033-8172-68d338d12288-kube-api-access-nxp5x\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116448 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cdf1330a-11b7-4033-8172-68d338d12288-device-dir\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.117198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116479 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-etc-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117727 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116569 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-cni-netd\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117727 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116584 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-etc-openvswitch\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117727 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116597 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-ovnkube-config\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117727 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.116628 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1d91dba-ad25-46be-9e87-06b814da1abf-host-cni-netd\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.117727 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.117075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1d91dba-ad25-46be-9e87-06b814da1abf-ovnkube-config\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.118213 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.118191 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/586b98f9-bf13-49c5-8566-3e6ca679886d-agent-certs\") pod \"konnectivity-agent-qn7sb\" (UID: \"586b98f9-bf13-49c5-8566-3e6ca679886d\") " pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.118569 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.118548 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1d91dba-ad25-46be-9e87-06b814da1abf-ovn-node-metrics-cert\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.122819 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.122795 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb88d\" (UniqueName: \"kubernetes.io/projected/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-kube-api-access-mb88d\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.123021 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.122995 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmg6j\" (UniqueName: \"kubernetes.io/projected/1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c-kube-api-access-lmg6j\") pod \"iptables-alerter-hk6z2\" (UID: \"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c\") " pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.123212 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.123193 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptrtd\" (UniqueName: \"kubernetes.io/projected/9e03de92-1707-4347-9a1a-a8f9d499f853-kube-api-access-ptrtd\") pod \"node-resolver-tgzrg\" (UID: \"9e03de92-1707-4347-9a1a-a8f9d499f853\") " pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.123550 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.123534 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqv27\" (UniqueName: \"kubernetes.io/projected/e1d91dba-ad25-46be-9e87-06b814da1abf-kube-api-access-mqv27\") pod \"ovnkube-node-mbdtj\" (UID: \"e1d91dba-ad25-46be-9e87-06b814da1abf\") " pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.123930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.123911 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lcsj\" (UniqueName: \"kubernetes.io/projected/7bc0ef35-081a-4873-9207-121947a1ce06-kube-api-access-6lcsj\") pod \"node-ca-qs9z2\" (UID: \"7bc0ef35-081a-4873-9207-121947a1ce06\") " pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.125503 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.125482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxp5x\" (UniqueName: \"kubernetes.io/projected/cdf1330a-11b7-4033-8172-68d338d12288-kube-api-access-nxp5x\") pod \"aws-ebs-csi-driver-node-p7tbs\" (UID: \"cdf1330a-11b7-4033-8172-68d338d12288\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.142725 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.142685 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3d24e025e3c6e3273d82141c242944.slice/crio-d37ec4fa3e80ae6a9d4dc74242d1069885ffd6f44c76528a77d966432fab361d WatchSource:0}: Error finding container d37ec4fa3e80ae6a9d4dc74242d1069885ffd6f44c76528a77d966432fab361d: Status 404 returned error can't find the container with id d37ec4fa3e80ae6a9d4dc74242d1069885ffd6f44c76528a77d966432fab361d Jun 02 01:56:32.142920 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.142905 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23004b7e1a83c12f34e3d0929fcfb824.slice/crio-f6f926bedbc32802dd8220990699345a84d08fc4d25faa87ab3ef28b8ac0346d WatchSource:0}: Error finding container f6f926bedbc32802dd8220990699345a84d08fc4d25faa87ab3ef28b8ac0346d: Status 404 returned error can't find the container with id f6f926bedbc32802dd8220990699345a84d08fc4d25faa87ab3ef28b8ac0346d Jun 02 01:56:32.148710 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.146387 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:56:32.216810 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216775 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-sys\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.216810 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216808 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-os-release\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216825 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-netns\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216840 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-cni-bin\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216880 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-cni-bin\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216906 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysconfig\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216914 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-os-release\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-sys\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216940 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysconfig\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-run\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216921 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-run\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-netns\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.216980 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b722g\" (UniqueName: \"kubernetes.io/projected/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-kube-api-access-b722g\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.217010 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217008 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-cni-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217028 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5pt\" (UniqueName: \"kubernetes.io/projected/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-kube-api-access-8n5pt\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217046 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-cnibin\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217062 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-cni-binary-copy\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217078 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-daemon-config\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217104 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-systemd\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217130 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217134 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-cni-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217141 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-cnibin\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217169 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-modprobe-d\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217180 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-system-cni-dir\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217195 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ada76d3-24f1-4a99-a924-c511d7681fce-tmp\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-systemd\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217217 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217241 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysctl-d\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217262 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-tuned\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-modprobe-d\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217287 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-47fx6\" (UniqueName: \"kubernetes.io/projected/0ada76d3-24f1-4a99-a924-c511d7681fce-kube-api-access-47fx6\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.218268 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217312 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-system-cni-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217342 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-var-lib-kubelet\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217363 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cnibin\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217388 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-hostroot\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217413 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217419 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-system-cni-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217436 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysctl-conf\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217462 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217471 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-var-lib-kubelet\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217345 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysctl-d\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217491 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-os-release\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cnibin\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217552 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-conf-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217556 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-os-release\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217579 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-etc-kubernetes\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217609 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-host\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217633 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-k8s-cni-cncf-io\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217681 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-multus-certs\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219111 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-sysctl-conf\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217711 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-hostroot\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217726 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-lib-modules\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217759 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-socket-dir-parent\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217774 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-cni-binary-copy\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217783 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-cni-multus\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-cni-multus\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217820 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-lib-modules\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217842 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-kubernetes\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217848 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-host\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217852 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-conf-dir\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-daemon-config\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217901 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-multus-socket-dir-parent\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-k8s-cni-cncf-io\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-kubernetes\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.217928 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218009 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-run-multus-certs\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218014 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.219930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218039 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-kubelet\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218056 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-etc-kubernetes\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-host-var-lib-kubelet\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218786 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.218845 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.219485 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0ada76d3-24f1-4a99-a924-c511d7681fce-etc-tuned\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.220405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.219934 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ada76d3-24f1-4a99-a924-c511d7681fce-tmp\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.223086 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.223070 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:32.223132 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.223088 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:32.223132 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.223096 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:32.223196 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.223150 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:56:32.723136843 +0000 UTC m=+2.222680488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:32.225136 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.225111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47fx6\" (UniqueName: \"kubernetes.io/projected/0ada76d3-24f1-4a99-a924-c511d7681fce-kube-api-access-47fx6\") pod \"tuned-zgklx\" (UID: \"0ada76d3-24f1-4a99-a924-c511d7681fce\") " pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.225584 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.225569 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5pt\" (UniqueName: \"kubernetes.io/projected/9c290ded-4e9c-4bed-9174-4b62bd3ed78f-kube-api-access-8n5pt\") pod \"multus-q77rp\" (UID: \"9c290ded-4e9c-4bed-9174-4b62bd3ed78f\") " pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.225697 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.225682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b722g\" (UniqueName: \"kubernetes.io/projected/af737d9f-0a48-4ee9-a9f7-ab8de6177a6e-kube-api-access-b722g\") pod \"multus-additional-cni-plugins-tpbkk\" (UID: \"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e\") " pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.334013 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.333993 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qs9z2" Jun 02 01:56:32.339987 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.339966 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc0ef35_081a_4873_9207_121947a1ce06.slice/crio-ae2dff04f9e99aae1dcd53643d67ad97d2cd9f7d06ef15edeaf401be3142d55f WatchSource:0}: Error finding container ae2dff04f9e99aae1dcd53643d67ad97d2cd9f7d06ef15edeaf401be3142d55f: Status 404 returned error can't find the container with id ae2dff04f9e99aae1dcd53643d67ad97d2cd9f7d06ef15edeaf401be3142d55f Jun 02 01:56:32.349349 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.349331 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hk6z2" Jun 02 01:56:32.355539 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.355517 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd8ca2a_70bd_467d_a35f_8d3a3b7d3c1c.slice/crio-c51e091af95d0dbbee575533503b3f2b1fe3493ed6086793e55e19f400ceb2d2 WatchSource:0}: Error finding container c51e091af95d0dbbee575533503b3f2b1fe3493ed6086793e55e19f400ceb2d2: Status 404 returned error can't find the container with id c51e091af95d0dbbee575533503b3f2b1fe3493ed6086793e55e19f400ceb2d2 Jun 02 01:56:32.364214 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.364198 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:32.369370 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.369350 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d91dba_ad25_46be_9e87_06b814da1abf.slice/crio-7d43ac3942e6181e326acb82d9ee81d1d3992f6f21207a6ba658a71d40b2fefe WatchSource:0}: Error finding container 7d43ac3942e6181e326acb82d9ee81d1d3992f6f21207a6ba658a71d40b2fefe: Status 404 returned error can't find the container with id 7d43ac3942e6181e326acb82d9ee81d1d3992f6f21207a6ba658a71d40b2fefe Jun 02 01:56:32.382121 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.382099 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" Jun 02 01:56:32.387768 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.387747 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdf1330a_11b7_4033_8172_68d338d12288.slice/crio-3b7dfa5b550f224c1a5defa4029d8595bea4219153e038bd2e61e4d0209944a2 WatchSource:0}: Error finding container 3b7dfa5b550f224c1a5defa4029d8595bea4219153e038bd2e61e4d0209944a2: Status 404 returned error can't find the container with id 3b7dfa5b550f224c1a5defa4029d8595bea4219153e038bd2e61e4d0209944a2 Jun 02 01:56:32.392633 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.392617 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:32.398110 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.398091 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586b98f9_bf13_49c5_8566_3e6ca679886d.slice/crio-965b78b3de5e1d29c89975b4d3d70bf6229b9e43d66749d513feb7f66f48049a WatchSource:0}: Error finding container 965b78b3de5e1d29c89975b4d3d70bf6229b9e43d66749d513feb7f66f48049a: Status 404 returned error can't find the container with id 965b78b3de5e1d29c89975b4d3d70bf6229b9e43d66749d513feb7f66f48049a Jun 02 01:56:32.405354 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.405337 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tgzrg" Jun 02 01:56:32.411400 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.411381 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e03de92_1707_4347_9a1a_a8f9d499f853.slice/crio-f6ed7fbc660eb312f7aa079062f5fbb231d7613c471fbd117b8026315e7879de WatchSource:0}: Error finding container f6ed7fbc660eb312f7aa079062f5fbb231d7613c471fbd117b8026315e7879de: Status 404 returned error can't find the container with id f6ed7fbc660eb312f7aa079062f5fbb231d7613c471fbd117b8026315e7879de Jun 02 01:56:32.419136 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.419119 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" Jun 02 01:56:32.424392 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.424374 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf737d9f_0a48_4ee9_a9f7_ab8de6177a6e.slice/crio-060758bd15ba29ad7c5e959ab9a90cacc131b4a445d4582d29451148e4e5d771 WatchSource:0}: Error finding container 060758bd15ba29ad7c5e959ab9a90cacc131b4a445d4582d29451148e4e5d771: Status 404 returned error can't find the container with id 060758bd15ba29ad7c5e959ab9a90cacc131b4a445d4582d29451148e4e5d771 Jun 02 01:56:32.443844 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.443823 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q77rp" Jun 02 01:56:32.450146 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.450127 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c290ded_4e9c_4bed_9174_4b62bd3ed78f.slice/crio-2e04b2f27a732e42376758118c73e81af5b05e6f20451260d9b34baa2a92d019 WatchSource:0}: Error finding container 2e04b2f27a732e42376758118c73e81af5b05e6f20451260d9b34baa2a92d019: Status 404 returned error can't find the container with id 2e04b2f27a732e42376758118c73e81af5b05e6f20451260d9b34baa2a92d019 Jun 02 01:56:32.451357 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.451344 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zgklx" Jun 02 01:56:32.457326 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:56:32.457307 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ada76d3_24f1_4a99_a924_c511d7681fce.slice/crio-804fa1bd39082f03e8f07b6c2dddf49c8f45c1d1ec3b95a2b152e0b895625ed8 WatchSource:0}: Error finding container 804fa1bd39082f03e8f07b6c2dddf49c8f45c1d1ec3b95a2b152e0b895625ed8: Status 404 returned error can't find the container with id 804fa1bd39082f03e8f07b6c2dddf49c8f45c1d1ec3b95a2b152e0b895625ed8 Jun 02 01:56:32.621170 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.621135 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:32.621359 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.621295 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:32.621359 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.621348 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:56:33.621335099 +0000 UTC m=+3.120878744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:32.815654 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.815578 2579 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:32.822447 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:32.822408 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:32.822652 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.822585 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:32.822652 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.822604 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:32.822652 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.822618 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:32.822805 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:32.822691 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:56:33.822654591 +0000 UTC m=+3.322198241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:33.054714 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.054655 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:51:32 +0000 UTC" deadline="2027-11-09 13:17:40.398861365 +0000 UTC" Jun 02 01:56:33.054714 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.054712 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12611h21m7.344153124s" Jun 02 01:56:33.130786 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.130685 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q77rp" event={"ID":"9c290ded-4e9c-4bed-9174-4b62bd3ed78f","Type":"ContainerStarted","Data":"2e04b2f27a732e42376758118c73e81af5b05e6f20451260d9b34baa2a92d019"} Jun 02 01:56:33.135871 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.135812 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tgzrg" event={"ID":"9e03de92-1707-4347-9a1a-a8f9d499f853","Type":"ContainerStarted","Data":"f6ed7fbc660eb312f7aa079062f5fbb231d7613c471fbd117b8026315e7879de"} Jun 02 01:56:33.137382 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.137306 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" event={"ID":"cdf1330a-11b7-4033-8172-68d338d12288","Type":"ContainerStarted","Data":"3b7dfa5b550f224c1a5defa4029d8595bea4219153e038bd2e61e4d0209944a2"} Jun 02 01:56:33.139633 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.139576 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hk6z2" event={"ID":"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c","Type":"ContainerStarted","Data":"c51e091af95d0dbbee575533503b3f2b1fe3493ed6086793e55e19f400ceb2d2"} Jun 02 01:56:33.143713 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.143688 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" event={"ID":"4d3d24e025e3c6e3273d82141c242944","Type":"ContainerStarted","Data":"d37ec4fa3e80ae6a9d4dc74242d1069885ffd6f44c76528a77d966432fab361d"} Jun 02 01:56:33.158197 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.158156 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" event={"ID":"23004b7e1a83c12f34e3d0929fcfb824","Type":"ContainerStarted","Data":"f6f926bedbc32802dd8220990699345a84d08fc4d25faa87ab3ef28b8ac0346d"} Jun 02 01:56:33.173025 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.172918 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgklx" event={"ID":"0ada76d3-24f1-4a99-a924-c511d7681fce","Type":"ContainerStarted","Data":"804fa1bd39082f03e8f07b6c2dddf49c8f45c1d1ec3b95a2b152e0b895625ed8"} Jun 02 01:56:33.181024 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.180829 2579 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:33.192902 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.192832 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerStarted","Data":"060758bd15ba29ad7c5e959ab9a90cacc131b4a445d4582d29451148e4e5d771"} Jun 02 01:56:33.210175 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.210136 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qn7sb" event={"ID":"586b98f9-bf13-49c5-8566-3e6ca679886d","Type":"ContainerStarted","Data":"965b78b3de5e1d29c89975b4d3d70bf6229b9e43d66749d513feb7f66f48049a"} Jun 02 01:56:33.216975 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.216942 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"7d43ac3942e6181e326acb82d9ee81d1d3992f6f21207a6ba658a71d40b2fefe"} Jun 02 01:56:33.225247 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.225215 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qs9z2" event={"ID":"7bc0ef35-081a-4873-9207-121947a1ce06","Type":"ContainerStarted","Data":"ae2dff04f9e99aae1dcd53643d67ad97d2cd9f7d06ef15edeaf401be3142d55f"} Jun 02 01:56:33.250156 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.250128 2579 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:56:33.631144 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.630494 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:33.631144 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:33.630673 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:33.631144 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:33.630740 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:56:35.63072074 +0000 UTC m=+5.130264393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:33.832895 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:33.832859 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:33.833078 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:33.833030 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:33.833078 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:33.833049 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:33.833078 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:33.833062 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:33.833227 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:33.833117 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:56:35.833098986 +0000 UTC m=+5.332642632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:34.055883 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:34.055763 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:51:32 +0000 UTC" deadline="2027-11-11 14:15:18.352291562 +0000 UTC" Jun 02 01:56:34.055883 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:34.055811 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12660h18m44.296484594s" Jun 02 01:56:34.102443 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:34.102387 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:34.102620 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:34.102570 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:34.102990 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:34.102973 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:34.103067 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:34.103050 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:35.646734 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:35.646488 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:35.647191 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:35.646753 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:35.647191 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:35.646848 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:56:39.646816731 +0000 UTC m=+9.146360379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:35.848559 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:35.848520 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:35.848745 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:35.848730 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:35.848813 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:35.848752 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:35.848813 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:35.848765 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:35.848896 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:35.848825 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:56:39.848806923 +0000 UTC m=+9.348350574 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:36.102875 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:36.102828 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:36.103060 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:36.102973 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:36.103060 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:36.103047 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:36.103159 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:36.103113 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:38.103912 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:38.103176 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:38.103912 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:38.103319 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:38.103912 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:38.103779 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:38.103912 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:38.103865 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:39.684737 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:39.684694 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:39.685244 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:39.684865 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:39.685244 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:39.684932 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:56:47.684913096 +0000 UTC m=+17.184456743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:39.886538 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:39.886499 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:39.886749 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:39.886700 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:39.886749 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:39.886720 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:39.886749 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:39.886733 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:39.886910 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:39.886783 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:56:47.886766067 +0000 UTC m=+17.386309712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:40.102495 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:40.102091 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:40.102495 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:40.102117 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:40.102495 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:40.102207 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:40.102495 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:40.102374 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:42.102586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:42.102542 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:42.103080 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:42.102710 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:42.103235 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:42.102542 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:42.103332 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:42.103310 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:44.102488 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:44.102448 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:44.102923 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:44.102452 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:44.102923 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:44.102581 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:44.102923 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:44.102678 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:46.102547 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:46.102115 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:46.102547 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:46.102115 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:46.102547 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:46.102228 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:46.102547 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:46.102328 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:47.741765 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:47.741722 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:47.742260 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:47.741869 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:47.742260 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:47.741932 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:57:03.741911711 +0000 UTC m=+33.241455365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:47.943423 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:47.943385 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:47.943584 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:47.943506 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:47.943584 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:47.943525 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:47.943584 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:47.943535 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:47.943736 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:47.943596 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:57:03.943576868 +0000 UTC m=+33.443120515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:48.102383 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:48.102347 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:48.102567 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:48.102354 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:48.102567 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:48.102465 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:48.102704 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:48.102566 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:50.102738 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:50.102703 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:50.103250 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:50.102716 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:50.103250 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:50.102816 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:50.103250 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:50.102933 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:52.102408 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.102376 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:52.102762 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:52.102548 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:52.102887 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.102862 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:52.103024 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:52.102967 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:52.270248 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.270095 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zgklx" event={"ID":"0ada76d3-24f1-4a99-a924-c511d7681fce","Type":"ContainerStarted","Data":"47c73364e49dfbda8963bd608d5199206096ae4de8c07d0d384289682383bcde"} Jun 02 01:56:52.275346 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.275154 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"a6acd045bc108c8b615f0157e9c3a7bb3d015708f3ec1f6e623214a0f2682916"} Jun 02 01:56:52.279500 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.279475 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q77rp" event={"ID":"9c290ded-4e9c-4bed-9174-4b62bd3ed78f","Type":"ContainerStarted","Data":"f3d1517dc767c3fbc78d236f2ee1bbae774a987521664678194db825d9e10c12"} Jun 02 01:56:52.287168 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.287130 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" event={"ID":"23004b7e1a83c12f34e3d0929fcfb824","Type":"ContainerStarted","Data":"b8adb3ca21c3802c9dcae0ead150782512f1822cf9b5e370b4ce6408e1d8eeb6"} Jun 02 01:56:52.289448 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.289391 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zgklx" podStartSLOduration=2.03466653 podStartE2EDuration="21.289374817s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.458724799 +0000 UTC m=+1.958268444" lastFinishedPulling="2026-06-02 01:56:51.713433071 +0000 UTC m=+21.212976731" observedRunningTime="2026-06-02 01:56:52.289304923 +0000 UTC m=+21.788848591" watchObservedRunningTime="2026-06-02 01:56:52.289374817 +0000 UTC m=+21.788918485" Jun 02 01:56:52.322440 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:52.322394 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-q77rp" podStartSLOduration=2.029469207 podStartE2EDuration="21.322382846s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.451466824 +0000 UTC m=+1.951010471" lastFinishedPulling="2026-06-02 01:56:51.744380465 +0000 UTC m=+21.243924110" observedRunningTime="2026-06-02 01:56:52.307427812 +0000 UTC m=+21.806971479" watchObservedRunningTime="2026-06-02 01:56:52.322382846 +0000 UTC m=+21.821926516" Jun 02 01:56:53.289823 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.289564 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qn7sb" event={"ID":"586b98f9-bf13-49c5-8566-3e6ca679886d","Type":"ContainerStarted","Data":"0c3d69f365a1c9dfa68532ada531884c140a3d7b4c014a5e24f47ad050718359"} Jun 02 01:56:53.291890 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.291866 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"3d45a7fdad1cbd7a91454ce53ac92d4b6eb5574133bb422918e93cfd59982482"} Jun 02 01:56:53.292011 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.291897 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"926665579aa9015b5056538a155039d15a6fdc1aeeb55c7fcd1517751e64d014"} Jun 02 01:56:53.292011 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.291911 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"5cb7905b012d11d8bbf76a53bd33c6407d4c1bc1b501a98b99d8f64fb88c2afa"} Jun 02 01:56:53.292011 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.291922 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"1362fe202758dc8a8f16dbf4f4c4a13429b9cc1edd240475be065cb02951ba29"} Jun 02 01:56:53.292011 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.291934 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"02ef12dc259489bc09336379bb29469805f1b3a9e195a6ff630b6d8798780003"} Jun 02 01:56:53.292930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.292909 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qs9z2" event={"ID":"7bc0ef35-081a-4873-9207-121947a1ce06","Type":"ContainerStarted","Data":"0e156221c236931edf1d5eb1b20a45d722f61db6bc0070263837321b7381e7e6"} Jun 02 01:56:53.294146 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.294122 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tgzrg" event={"ID":"9e03de92-1707-4347-9a1a-a8f9d499f853","Type":"ContainerStarted","Data":"8084cdcbfe75dbf23a42db920ebb7febd323904ca835b36a642d1d7c0407226d"} Jun 02 01:56:53.295343 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.295323 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" event={"ID":"cdf1330a-11b7-4033-8172-68d338d12288","Type":"ContainerStarted","Data":"f2d4b27b5c449aad344a67165aea1e8807f1b0f86c8e4fb39a0e69997c06620e"} Jun 02 01:56:53.296498 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.296480 2579 generic.go:358] "Generic (PLEG): container finished" podID="4d3d24e025e3c6e3273d82141c242944" containerID="4f1d4634efdaf397eefffb3a79f6227bc7ce8af1fbec39ab7fb500e6013d7b48" exitCode=0 Jun 02 01:56:53.296580 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.296533 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" event={"ID":"4d3d24e025e3c6e3273d82141c242944","Type":"ContainerDied","Data":"4f1d4634efdaf397eefffb3a79f6227bc7ce8af1fbec39ab7fb500e6013d7b48"} Jun 02 01:56:53.297755 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.297725 2579 generic.go:358] "Generic (PLEG): container finished" podID="af737d9f-0a48-4ee9-a9f7-ab8de6177a6e" containerID="487b2713f7a97d4f649f0ab531a618876fb824cf5d221b9aae9f091fd9367027" exitCode=0 Jun 02 01:56:53.297755 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.297748 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerDied","Data":"487b2713f7a97d4f649f0ab531a618876fb824cf5d221b9aae9f091fd9367027"} Jun 02 01:56:53.305197 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.305165 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qn7sb" podStartSLOduration=2.991160862 podStartE2EDuration="22.305155833s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.399454957 +0000 UTC m=+1.898998603" lastFinishedPulling="2026-06-02 01:56:51.713449911 +0000 UTC m=+21.212993574" observedRunningTime="2026-06-02 01:56:53.304899274 +0000 UTC m=+22.804442942" watchObservedRunningTime="2026-06-02 01:56:53.305155833 +0000 UTC m=+22.804699500" Jun 02 01:56:53.305274 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.305226 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-106.ec2.internal" podStartSLOduration=22.305222361 podStartE2EDuration="22.305222361s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:56:52.322818203 +0000 UTC m=+21.822361869" watchObservedRunningTime="2026-06-02 01:56:53.305222361 +0000 UTC m=+22.804766026" Jun 02 01:56:53.332769 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.332734 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qs9z2" podStartSLOduration=2.962439886 podStartE2EDuration="22.332721597s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.341575778 +0000 UTC m=+1.841119424" lastFinishedPulling="2026-06-02 01:56:51.711857475 +0000 UTC m=+21.211401135" observedRunningTime="2026-06-02 01:56:53.332331867 +0000 UTC m=+22.831875536" watchObservedRunningTime="2026-06-02 01:56:53.332721597 +0000 UTC m=+22.832265263" Jun 02 01:56:53.346136 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.346079 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-tgzrg" podStartSLOduration=3.09628078 podStartE2EDuration="22.346063357s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.412775802 +0000 UTC m=+1.912319447" lastFinishedPulling="2026-06-02 01:56:51.662558369 +0000 UTC m=+21.162102024" observedRunningTime="2026-06-02 01:56:53.345836583 +0000 UTC m=+22.845380250" watchObservedRunningTime="2026-06-02 01:56:53.346063357 +0000 UTC m=+22.845607025" Jun 02 01:56:53.714587 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:53.714563 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:56:54.098332 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.098232 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:56:53.714580462Z","UUID":"da729e1e-b9c4-4a2f-a93d-455875950f83","Handler":null,"Name":"","Endpoint":""} Jun 02 01:56:54.099918 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.099892 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:56:54.099918 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.099922 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:56:54.102213 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.102123 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:54.102323 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.102123 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:54.102323 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:54.102246 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:54.102433 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:54.102341 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:54.301490 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.301456 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" event={"ID":"cdf1330a-11b7-4033-8172-68d338d12288","Type":"ContainerStarted","Data":"789ff240ca002d62fd7cb3cc039904530411b862144f1e0a365231f2072dfe8a"} Jun 02 01:56:54.302718 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.302689 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hk6z2" event={"ID":"1cd8ca2a-70bd-467d-a35f-8d3a3b7d3c1c","Type":"ContainerStarted","Data":"da455d4b166b9525ae48a010561b3a78d4c15b25ac7cac3944b78810051dede5"} Jun 02 01:56:54.304204 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.304184 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" event={"ID":"4d3d24e025e3c6e3273d82141c242944","Type":"ContainerStarted","Data":"99b9648d03cae8a8a03bfde497a8f39aad383369987c61ba8d99db0565e169cc"} Jun 02 01:56:54.348097 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.348041 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-106.ec2.internal" podStartSLOduration=23.348028513 podStartE2EDuration="23.348028513s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:56:54.347828627 +0000 UTC m=+23.847372294" watchObservedRunningTime="2026-06-02 01:56:54.348028513 +0000 UTC m=+23.847572180" Jun 02 01:56:54.348499 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:54.348424 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hk6z2" podStartSLOduration=3.991552133 podStartE2EDuration="23.348416651s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.356979598 +0000 UTC m=+1.856523246" lastFinishedPulling="2026-06-02 01:56:51.713844106 +0000 UTC m=+21.213387764" observedRunningTime="2026-06-02 01:56:54.330343427 +0000 UTC m=+23.829887094" watchObservedRunningTime="2026-06-02 01:56:54.348416651 +0000 UTC m=+23.847960352" Jun 02 01:56:55.309246 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:55.309154 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"5275fcbc51d894c2095fa5fc3af67d65ff47f792bd48bc03b7627981dd2df929"} Jun 02 01:56:55.311817 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:55.311232 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" event={"ID":"cdf1330a-11b7-4033-8172-68d338d12288","Type":"ContainerStarted","Data":"00aa98ca234c33aab188852b437e2aabea38a36323b5784006f068a62ecc4f0c"} Jun 02 01:56:56.102675 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:56.102626 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:56.102861 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:56.102626 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:56.102861 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:56.102782 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:56.102861 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:56.102806 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:56.761932 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:56.761898 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:56.762600 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:56.762581 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:56.779449 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:56.779408 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p7tbs" podStartSLOduration=3.253193601 podStartE2EDuration="25.779392537s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.38926077 +0000 UTC m=+1.888804429" lastFinishedPulling="2026-06-02 01:56:54.915459711 +0000 UTC m=+24.415003365" observedRunningTime="2026-06-02 01:56:55.330078299 +0000 UTC m=+24.829621966" watchObservedRunningTime="2026-06-02 01:56:56.779392537 +0000 UTC m=+26.278936206" Jun 02 01:56:57.878855 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:57.878694 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:57.879604 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:57.879362 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qn7sb" Jun 02 01:56:58.102816 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.102789 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:58.102981 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.102789 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:58.102981 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:58.102882 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:58.102981 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:58.102971 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:56:58.318334 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.318257 2579 generic.go:358] "Generic (PLEG): container finished" podID="af737d9f-0a48-4ee9-a9f7-ab8de6177a6e" containerID="1fe18e3271a6120eba70842d210b652fbd3d8424c2f2f4f8b9581a6538526bd8" exitCode=0 Jun 02 01:56:58.318334 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.318322 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerDied","Data":"1fe18e3271a6120eba70842d210b652fbd3d8424c2f2f4f8b9581a6538526bd8"} Jun 02 01:56:58.321825 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.321791 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" event={"ID":"e1d91dba-ad25-46be-9e87-06b814da1abf","Type":"ContainerStarted","Data":"51b578e0afa6c12b6d39ff7ed1a617b1f1c9ab9c44c47e156cba6e39a9fc1673"} Jun 02 01:56:58.322071 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.322054 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:58.322151 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.322077 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:58.338144 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.338121 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:58.367629 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:58.367589 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" podStartSLOduration=7.63354885 podStartE2EDuration="27.367577871s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.371133855 +0000 UTC m=+1.870677501" lastFinishedPulling="2026-06-02 01:56:52.105162864 +0000 UTC m=+21.604706522" observedRunningTime="2026-06-02 01:56:58.365825798 +0000 UTC m=+27.865369476" watchObservedRunningTime="2026-06-02 01:56:58.367577871 +0000 UTC m=+27.867121537" Jun 02 01:56:59.325620 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.325588 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerStarted","Data":"25adde01cf9f0433cf4b0ee6e104c01f50ce8a7e7328c91d4727869081a157b4"} Jun 02 01:56:59.326510 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.326368 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:59.341480 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.341460 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:56:59.713167 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.713143 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zbj67"] Jun 02 01:56:59.713403 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.713236 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:56:59.713403 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:59.713309 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:56:59.714021 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.713760 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkmb5"] Jun 02 01:56:59.714021 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:56:59.713882 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:56:59.714021 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:56:59.713992 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:57:00.328714 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:00.328682 2579 generic.go:358] "Generic (PLEG): container finished" podID="af737d9f-0a48-4ee9-a9f7-ab8de6177a6e" containerID="25adde01cf9f0433cf4b0ee6e104c01f50ce8a7e7328c91d4727869081a157b4" exitCode=0 Jun 02 01:57:00.329125 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:00.328753 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerDied","Data":"25adde01cf9f0433cf4b0ee6e104c01f50ce8a7e7328c91d4727869081a157b4"} Jun 02 01:57:01.103148 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:01.103124 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:01.103300 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:01.103229 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:57:01.103360 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:01.103305 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:57:01.103436 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:01.103415 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:57:01.333212 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:01.333122 2579 generic.go:358] "Generic (PLEG): container finished" podID="af737d9f-0a48-4ee9-a9f7-ab8de6177a6e" containerID="f58481e7586e47b68bbeb37e3728ff5adaa9819819538abcbc03748aa3d08f1a" exitCode=0 Jun 02 01:57:01.333530 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:01.333206 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerDied","Data":"f58481e7586e47b68bbeb37e3728ff5adaa9819819538abcbc03748aa3d08f1a"} Jun 02 01:57:03.102525 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:03.102294 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:03.102957 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:03.102330 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:57:03.102957 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.102630 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zbj67" podUID="0702c4e2-146a-41e5-b430-9bd275a27e0e" Jun 02 01:57:03.102957 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.102730 2579 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gkmb5" podUID="8279cd15-4d48-4db4-9f0a-6f96b3a21c2d" Jun 02 01:57:03.756522 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:03.756486 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:57:03.756767 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.756682 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:57:03.756825 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.756779 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:57:35.756758775 +0000 UTC m=+65.256302436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:57:03.958082 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:03.958038 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:03.958247 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.958203 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:57:03.958247 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.958229 2579 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:57:03.958247 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.958243 2579 projected.go:194] Error preparing data for projected volume kube-api-access-659jh for pod openshift-network-diagnostics/network-check-target-zbj67: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:57:03.958352 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:03.958295 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh podName:0702c4e2-146a-41e5-b430-9bd275a27e0e nodeName:}" failed. No retries permitted until 2026-06-02 01:57:35.958281746 +0000 UTC m=+65.457825395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-659jh" (UniqueName: "kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh") pod "network-check-target-zbj67" (UID: "0702c4e2-146a-41e5-b430-9bd275a27e0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:57:04.789881 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.789800 2579 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-131-106.ec2.internal" event="NodeReady" Jun 02 01:57:04.790306 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.789947 2579 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:57:04.855163 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.855132 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fmr8x"] Jun 02 01:57:04.917992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.917957 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-flrpl"] Jun 02 01:57:04.918165 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.918127 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:04.922328 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.922308 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:57:04.922449 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.922346 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74htp\"" Jun 02 01:57:04.922449 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.922359 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:57:04.931127 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.931110 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fmr8x"] Jun 02 01:57:04.931127 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.931129 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-flrpl"] Jun 02 01:57:04.931238 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.931200 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:04.937039 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.937020 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:57:04.937271 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.937250 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:57:04.937395 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.937381 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6j559\"" Jun 02 01:57:04.939288 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:04.939274 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:57:05.066407 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.066312 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:05.066407 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.066353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f37939-1151-4303-ad65-604b2fd38d25-tmp-dir\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.066600 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.066408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00f37939-1151-4303-ad65-604b2fd38d25-config-volume\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.066600 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.066434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h4nd\" (UniqueName: \"kubernetes.io/projected/00f37939-1151-4303-ad65-604b2fd38d25-kube-api-access-5h4nd\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.066600 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.066482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkknh\" (UniqueName: \"kubernetes.io/projected/354a6bea-a69e-4422-b6d2-78d2419bdcc1-kube-api-access-pkknh\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:05.066600 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.066512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.102579 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.102546 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:05.102762 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.102742 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:57:05.105932 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.105910 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tc66q\"" Jun 02 01:57:05.106220 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.106202 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:57:05.106394 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.106378 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:57:05.106544 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.106530 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:57:05.106779 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.106759 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bqdvw\"" Jun 02 01:57:05.167116 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167076 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkknh\" (UniqueName: \"kubernetes.io/projected/354a6bea-a69e-4422-b6d2-78d2419bdcc1-kube-api-access-pkknh\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:05.167276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167128 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.167276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167180 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:05.167276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167204 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f37939-1151-4303-ad65-604b2fd38d25-tmp-dir\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.167276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167247 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00f37939-1151-4303-ad65-604b2fd38d25-config-volume\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.167276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167270 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h4nd\" (UniqueName: \"kubernetes.io/projected/00f37939-1151-4303-ad65-604b2fd38d25-kube-api-access-5h4nd\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.167522 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.167295 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:05.167522 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.167374 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:05.667357672 +0000 UTC m=+35.166901317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:05.167522 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.167464 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:05.167522 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.167521 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:05.667506163 +0000 UTC m=+35.167049824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:05.167787 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/00f37939-1151-4303-ad65-604b2fd38d25-tmp-dir\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.168016 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.167997 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/00f37939-1151-4303-ad65-604b2fd38d25-config-volume\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.183490 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.183466 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h4nd\" (UniqueName: \"kubernetes.io/projected/00f37939-1151-4303-ad65-604b2fd38d25-kube-api-access-5h4nd\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.183598 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.183506 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkknh\" (UniqueName: \"kubernetes.io/projected/354a6bea-a69e-4422-b6d2-78d2419bdcc1-kube-api-access-pkknh\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:05.672557 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.672520 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:05.672753 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:05.672584 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:05.672753 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.672701 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:05.672876 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.672772 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:06.672756857 +0000 UTC m=+36.172300505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:05.673135 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.672701 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:05.673220 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:05.673169 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:06.673151241 +0000 UTC m=+36.172694892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:06.679127 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:06.679089 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:06.679746 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:06.679160 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:06.679746 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:06.679231 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:06.679746 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:06.679279 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:06.679746 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:06.679301 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:08.679282175 +0000 UTC m=+38.178825839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:06.679746 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:06.679320 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:08.679310098 +0000 UTC m=+38.178853744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:08.348810 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:08.348777 2579 generic.go:358] "Generic (PLEG): container finished" podID="af737d9f-0a48-4ee9-a9f7-ab8de6177a6e" containerID="8220fa8f71ff0160252933dfb2648cac83113297d672a38dd87534afb191f9ae" exitCode=0 Jun 02 01:57:08.349272 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:08.348832 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerDied","Data":"8220fa8f71ff0160252933dfb2648cac83113297d672a38dd87534afb191f9ae"} Jun 02 01:57:08.693493 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:08.693410 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:08.693493 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:08.693461 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:08.693699 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:08.693546 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:08.693699 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:08.693544 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:08.693699 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:08.693607 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:12.693594444 +0000 UTC m=+42.193138089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:08.693699 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:08.693620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:12.693614707 +0000 UTC m=+42.193158356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:09.352872 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:09.352836 2579 generic.go:358] "Generic (PLEG): container finished" podID="af737d9f-0a48-4ee9-a9f7-ab8de6177a6e" containerID="c768c4a1e9cd13e919c33b1ff7ee698efebcf700733410d12e39d91fc4fccef4" exitCode=0 Jun 02 01:57:09.353232 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:09.352901 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerDied","Data":"c768c4a1e9cd13e919c33b1ff7ee698efebcf700733410d12e39d91fc4fccef4"} Jun 02 01:57:10.357739 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:10.357552 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" event={"ID":"af737d9f-0a48-4ee9-a9f7-ab8de6177a6e","Type":"ContainerStarted","Data":"350670d7881a9312332de8917e50ed36700611228016d933fa440e6543d4ecd6"} Jun 02 01:57:10.386988 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:10.386943 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tpbkk" podStartSLOduration=4.305077852 podStartE2EDuration="39.386928883s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:56:32.425625625 +0000 UTC m=+1.925169270" lastFinishedPulling="2026-06-02 01:57:07.507476642 +0000 UTC m=+37.007020301" observedRunningTime="2026-06-02 01:57:10.385063349 +0000 UTC m=+39.884607016" watchObservedRunningTime="2026-06-02 01:57:10.386928883 +0000 UTC m=+39.886472551" Jun 02 01:57:12.720073 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:12.720035 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:12.720453 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:12.720090 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:12.720453 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:12.720175 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:12.720453 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:12.720183 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:12.720453 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:12.720227 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:20.720213236 +0000 UTC m=+50.219756881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:12.720453 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:12.720245 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:20.720232566 +0000 UTC m=+50.219776214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:20.774232 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:20.774192 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:20.774771 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:20.774250 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:20.774771 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:20.774340 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:20.774771 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:20.774344 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:20.774771 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:20.774394 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:36.774380109 +0000 UTC m=+66.273923753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:20.774771 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:20.774406 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:36.774400402 +0000 UTC m=+66.273944047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:31.344246 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:31.344215 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mbdtj" Jun 02 01:57:35.773019 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:35.772965 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:57:35.776272 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:35.776251 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:57:35.783967 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:35.783945 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:57:35.784052 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:35.784041 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs podName:8279cd15-4d48-4db4-9f0a-6f96b3a21c2d nodeName:}" failed. No retries permitted until 2026-06-02 01:58:39.78402244 +0000 UTC m=+129.283566086 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs") pod "network-metrics-daemon-gkmb5" (UID: "8279cd15-4d48-4db4-9f0a-6f96b3a21c2d") : secret "metrics-daemon-secret" not found Jun 02 01:57:35.974442 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:35.974409 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:35.977984 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:35.977963 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:57:35.988869 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:35.988848 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:57:35.999007 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:35.998985 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659jh\" (UniqueName: \"kubernetes.io/projected/0702c4e2-146a-41e5-b430-9bd275a27e0e-kube-api-access-659jh\") pod \"network-check-target-zbj67\" (UID: \"0702c4e2-146a-41e5-b430-9bd275a27e0e\") " pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:36.017988 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:36.017962 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tc66q\"" Jun 02 01:57:36.025650 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:36.025600 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:36.174909 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:36.174879 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zbj67"] Jun 02 01:57:36.178506 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:57:36.178482 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0702c4e2_146a_41e5_b430_9bd275a27e0e.slice/crio-17bbf1854d054e50e87cf3dc76d74f79d51f451e869f87ac413ea71915d4cdfa WatchSource:0}: Error finding container 17bbf1854d054e50e87cf3dc76d74f79d51f451e869f87ac413ea71915d4cdfa: Status 404 returned error can't find the container with id 17bbf1854d054e50e87cf3dc76d74f79d51f451e869f87ac413ea71915d4cdfa Jun 02 01:57:36.404469 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:36.404432 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zbj67" event={"ID":"0702c4e2-146a-41e5-b430-9bd275a27e0e","Type":"ContainerStarted","Data":"17bbf1854d054e50e87cf3dc76d74f79d51f451e869f87ac413ea71915d4cdfa"} Jun 02 01:57:36.780198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:36.780111 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:57:36.780198 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:36.780173 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:57:36.780635 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:36.780266 2579 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:36.780635 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:36.780269 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:36.780635 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:36.780323 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert podName:354a6bea-a69e-4422-b6d2-78d2419bdcc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:08.78030869 +0000 UTC m=+98.279852335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert") pod "ingress-canary-flrpl" (UID: "354a6bea-a69e-4422-b6d2-78d2419bdcc1") : secret "canary-serving-cert" not found Jun 02 01:57:36.780635 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:36.780340 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls podName:00f37939-1151-4303-ad65-604b2fd38d25 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:08.780331918 +0000 UTC m=+98.279875563 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls") pod "dns-default-fmr8x" (UID: "00f37939-1151-4303-ad65-604b2fd38d25") : secret "dns-default-metrics-tls" not found Jun 02 01:57:39.411306 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:39.411269 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zbj67" event={"ID":"0702c4e2-146a-41e5-b430-9bd275a27e0e","Type":"ContainerStarted","Data":"bc5064c7d2be93630470af99f0c85f7505587ab7dd4fce6c062c18e9ebeb84c9"} Jun 02 01:57:39.411830 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:39.411396 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:57:39.433621 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:39.433567 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zbj67" podStartSLOduration=65.673848462 podStartE2EDuration="1m8.433548619s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:57:36.182638788 +0000 UTC m=+65.682182446" lastFinishedPulling="2026-06-02 01:57:38.942338958 +0000 UTC m=+68.441882603" observedRunningTime="2026-06-02 01:57:39.433230576 +0000 UTC m=+68.932774244" watchObservedRunningTime="2026-06-02 01:57:39.433548619 +0000 UTC m=+68.933092288" Jun 02 01:57:51.406559 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.406442 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764"] Jun 02 01:57:51.409075 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.409058 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.418708 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.418689 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 01:57:51.418797 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.418705 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:57:51.421806 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.421781 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:57:51.421920 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.421788 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 01:57:51.421920 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.421841 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b8hvf\"" Jun 02 01:57:51.422584 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.422564 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54cd7cd9c9-6c8fd"] Jun 02 01:57:51.425220 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.425206 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.428252 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.428233 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 01:57:51.428435 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.428420 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4zgv2\"" Jun 02 01:57:51.429060 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.429045 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 01:57:51.429144 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.429062 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 01:57:51.429144 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.429120 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 01:57:51.429329 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.429314 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:57:51.429798 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.429784 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:57:51.438012 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.437988 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764"] Jun 02 01:57:51.464587 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.464555 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54cd7cd9c9-6c8fd"] Jun 02 01:57:51.510595 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.510556 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9"] Jun 02 01:57:51.513227 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.513212 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:51.523112 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.523084 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 01:57:51.523320 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.523308 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p9qw9\"" Jun 02 01:57:51.527166 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.527146 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dkxp2"] Jun 02 01:57:51.528653 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.528634 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:57:51.529762 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.529749 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb"] Jun 02 01:57:51.529908 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.529892 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.532404 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.532386 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.537627 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.537607 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vlksk\"" Jun 02 01:57:51.538387 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.538352 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 01:57:51.538387 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.538363 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:57:51.538530 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.538495 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 01:57:51.539817 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.539215 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 01:57:51.539817 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.539220 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 01:57:51.540208 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.540186 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:57:51.540507 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.540490 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:57:51.541852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.541445 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gztl4\"" Jun 02 01:57:51.543992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.542293 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 01:57:51.543992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.543465 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 01:57:51.543992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.543606 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9"] Jun 02 01:57:51.544983 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.544956 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 01:57:51.562129 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.562078 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb"] Jun 02 01:57:51.570598 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.570569 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dkxp2"] Jun 02 01:57:51.581873 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.581846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvsc5\" (UniqueName: \"kubernetes.io/projected/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-kube-api-access-jvsc5\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.582023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.581884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.582023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.581944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/498a1b29-533d-42bf-be7d-6e277149cec6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.582023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.581972 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.582023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.581991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-stats-auth\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.582023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.582011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqx4s\" (UniqueName: \"kubernetes.io/projected/498a1b29-533d-42bf-be7d-6e277149cec6-kube-api-access-lqx4s\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.582254 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.582063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-default-certificate\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.582254 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.582133 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.682540 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682452 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnptk\" (UniqueName: \"kubernetes.io/projected/3d630ea1-2147-4486-8a39-8eaa45ffe09c-kube-api-access-xnptk\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.682540 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682497 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvsc5\" (UniqueName: \"kubernetes.io/projected/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-kube-api-access-jvsc5\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.682540 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e198b4a-906c-4558-bbf6-e00831ad8d00-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.682540 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682532 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e198b4a-906c-4558-bbf6-e00831ad8d00-serving-cert\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.682886 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682552 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.682886 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e198b4a-906c-4558-bbf6-e00831ad8d00-tmp\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.682886 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682710 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e198b4a-906c-4558-bbf6-e00831ad8d00-snapshots\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.682886 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.682789 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:52.182766712 +0000 UTC m=+81.682310381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : configmap references non-existent config key: service-ca.crt Jun 02 01:57:51.682886 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682882 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/498a1b29-533d-42bf-be7d-6e277149cec6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682907 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682927 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-stats-auth\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682945 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqx4s\" (UniqueName: \"kubernetes.io/projected/498a1b29-533d-42bf-be7d-6e277149cec6-kube-api-access-lqx4s\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.682964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xfwv\" (UniqueName: \"kubernetes.io/projected/7e198b4a-906c-4558-bbf6-e00831ad8d00-kube-api-access-7xfwv\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.683023 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:51.683110 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.683096 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls podName:498a1b29-533d-42bf-be7d-6e277149cec6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:52.183078322 +0000 UTC m=+81.682621975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xp764" (UID: "498a1b29-533d-42bf-be7d-6e277149cec6") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:51.683389 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d630ea1-2147-4486-8a39-8eaa45ffe09c-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.683389 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vn2z\" (UniqueName: \"kubernetes.io/projected/59c5298d-d284-439c-a11a-f134905d7cc6-kube-api-access-6vn2z\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:51.683389 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683199 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d630ea1-2147-4486-8a39-8eaa45ffe09c-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.683389 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683242 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e198b4a-906c-4558-bbf6-e00831ad8d00-service-ca-bundle\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.683389 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683285 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-default-certificate\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.683389 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683327 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.683645 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.683428 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:57:51.683645 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.683481 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:52.183465587 +0000 UTC m=+81.683009236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : secret "router-metrics-certs-default" not found Jun 02 01:57:51.683748 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.683706 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/498a1b29-533d-42bf-be7d-6e277149cec6-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.685613 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.685592 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-stats-auth\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.685738 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.685620 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-default-certificate\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.718233 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.718197 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvsc5\" (UniqueName: \"kubernetes.io/projected/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-kube-api-access-jvsc5\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:51.718379 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.718199 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqx4s\" (UniqueName: \"kubernetes.io/projected/498a1b29-533d-42bf-be7d-6e277149cec6-kube-api-access-lqx4s\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:51.783819 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.783774 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e198b4a-906c-4558-bbf6-e00831ad8d00-tmp\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.783819 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.783817 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e198b4a-906c-4558-bbf6-e00831ad8d00-snapshots\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784022 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.783951 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xfwv\" (UniqueName: \"kubernetes.io/projected/7e198b4a-906c-4558-bbf6-e00831ad8d00-kube-api-access-7xfwv\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784022 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.783988 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:51.784022 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784011 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d630ea1-2147-4486-8a39-8eaa45ffe09c-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.784149 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.784087 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:57:51.784205 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784155 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vn2z\" (UniqueName: \"kubernetes.io/projected/59c5298d-d284-439c-a11a-f134905d7cc6-kube-api-access-6vn2z\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:51.784205 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:51.784167 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls podName:59c5298d-d284-439c-a11a-f134905d7cc6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:52.284147434 +0000 UTC m=+81.783691098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-55lr9" (UID: "59c5298d-d284-439c-a11a-f134905d7cc6") : secret "samples-operator-tls" not found Jun 02 01:57:51.784314 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784207 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d630ea1-2147-4486-8a39-8eaa45ffe09c-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.784314 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784238 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e198b4a-906c-4558-bbf6-e00831ad8d00-service-ca-bundle\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784405 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784342 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnptk\" (UniqueName: \"kubernetes.io/projected/3d630ea1-2147-4486-8a39-8eaa45ffe09c-kube-api-access-xnptk\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.784498 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784473 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7e198b4a-906c-4558-bbf6-e00831ad8d00-snapshots\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784580 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784486 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e198b4a-906c-4558-bbf6-e00831ad8d00-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784580 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7e198b4a-906c-4558-bbf6-e00831ad8d00-tmp\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784580 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784536 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e198b4a-906c-4558-bbf6-e00831ad8d00-serving-cert\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.784803 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.784786 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3d630ea1-2147-4486-8a39-8eaa45ffe09c-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.785196 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.785179 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e198b4a-906c-4558-bbf6-e00831ad8d00-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.785255 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.785193 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e198b4a-906c-4558-bbf6-e00831ad8d00-service-ca-bundle\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.786486 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.786463 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3d630ea1-2147-4486-8a39-8eaa45ffe09c-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.786821 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.786802 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7e198b4a-906c-4558-bbf6-e00831ad8d00-serving-cert\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.815944 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.815916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnptk\" (UniqueName: \"kubernetes.io/projected/3d630ea1-2147-4486-8a39-8eaa45ffe09c-kube-api-access-xnptk\") pod \"kube-storage-version-migrator-operator-96ddc787c-sx5lb\" (UID: \"3d630ea1-2147-4486-8a39-8eaa45ffe09c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:51.816173 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.816154 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xfwv\" (UniqueName: \"kubernetes.io/projected/7e198b4a-906c-4558-bbf6-e00831ad8d00-kube-api-access-7xfwv\") pod \"insights-operator-788bf58df5-dkxp2\" (UID: \"7e198b4a-906c-4558-bbf6-e00831ad8d00\") " pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.818063 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.818043 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vn2z\" (UniqueName: \"kubernetes.io/projected/59c5298d-d284-439c-a11a-f134905d7cc6-kube-api-access-6vn2z\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:51.842059 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.842029 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" Jun 02 01:57:51.848751 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:51.848729 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" Jun 02 01:57:52.002456 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.002425 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-dkxp2"] Jun 02 01:57:52.005591 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:57:52.005562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e198b4a_906c_4558_bbf6_e00831ad8d00.slice/crio-e8ecd7ba5fcea45a39e9a879d2c0f98c5286db33e50895b0baa269c5ac79ae8c WatchSource:0}: Error finding container e8ecd7ba5fcea45a39e9a879d2c0f98c5286db33e50895b0baa269c5ac79ae8c: Status 404 returned error can't find the container with id e8ecd7ba5fcea45a39e9a879d2c0f98c5286db33e50895b0baa269c5ac79ae8c Jun 02 01:57:52.037755 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.037714 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb"] Jun 02 01:57:52.042890 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:57:52.042864 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d630ea1_2147_4486_8a39_8eaa45ffe09c.slice/crio-9c54dd427ebe8ec49b83c20bbb41b89dd96b78736a13730551e5cf221a71b539 WatchSource:0}: Error finding container 9c54dd427ebe8ec49b83c20bbb41b89dd96b78736a13730551e5cf221a71b539: Status 404 returned error can't find the container with id 9c54dd427ebe8ec49b83c20bbb41b89dd96b78736a13730551e5cf221a71b539 Jun 02 01:57:52.189847 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.189810 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:52.190054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.189883 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:52.190054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.189915 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:52.190054 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.189969 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:57:52.190054 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.190015 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:52.190054 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.190039 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:53.190023738 +0000 UTC m=+82.689567383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : secret "router-metrics-certs-default" not found Jun 02 01:57:52.190054 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.190059 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls podName:498a1b29-533d-42bf-be7d-6e277149cec6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:53.190047906 +0000 UTC m=+82.689591552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xp764" (UID: "498a1b29-533d-42bf-be7d-6e277149cec6") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:52.190357 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.190072 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:53.190065015 +0000 UTC m=+82.689608659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : configmap references non-existent config key: service-ca.crt Jun 02 01:57:52.291169 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.291071 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:52.291316 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.291218 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:57:52.291316 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:52.291285 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls podName:59c5298d-d284-439c-a11a-f134905d7cc6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:53.291266712 +0000 UTC m=+82.790810362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-55lr9" (UID: "59c5298d-d284-439c-a11a-f134905d7cc6") : secret "samples-operator-tls" not found Jun 02 01:57:52.437129 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.437077 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" event={"ID":"3d630ea1-2147-4486-8a39-8eaa45ffe09c","Type":"ContainerStarted","Data":"9c54dd427ebe8ec49b83c20bbb41b89dd96b78736a13730551e5cf221a71b539"} Jun 02 01:57:52.438315 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:52.438234 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" event={"ID":"7e198b4a-906c-4558-bbf6-e00831ad8d00","Type":"ContainerStarted","Data":"e8ecd7ba5fcea45a39e9a879d2c0f98c5286db33e50895b0baa269c5ac79ae8c"} Jun 02 01:57:53.197780 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:53.197746 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:53.197974 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:53.197838 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:53.197974 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.197906 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:53.197974 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:53.197915 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:53.197974 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.197974 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls podName:498a1b29-533d-42bf-be7d-6e277149cec6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:55.197954684 +0000 UTC m=+84.697498537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xp764" (UID: "498a1b29-533d-42bf-be7d-6e277149cec6") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:53.198130 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.198100 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:55.198087495 +0000 UTC m=+84.697631154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : configmap references non-existent config key: service-ca.crt Jun 02 01:57:53.198189 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.198168 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:57:53.198242 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.198202 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:55.198189291 +0000 UTC m=+84.697732938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : secret "router-metrics-certs-default" not found Jun 02 01:57:53.298366 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:53.298327 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:53.298571 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.298478 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:57:53.298571 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:53.298564 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls podName:59c5298d-d284-439c-a11a-f134905d7cc6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:55.29854049 +0000 UTC m=+84.798084137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-55lr9" (UID: "59c5298d-d284-439c-a11a-f134905d7cc6") : secret "samples-operator-tls" not found Jun 02 01:57:54.444086 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:54.444044 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" event={"ID":"7e198b4a-906c-4558-bbf6-e00831ad8d00","Type":"ContainerStarted","Data":"1d9060f3744afa65c887950295b202e1bbabb80d99f3e39e55071096857db964"} Jun 02 01:57:54.474899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:54.474837 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" podStartSLOduration=1.568389024 podStartE2EDuration="3.474821378s" podCreationTimestamp="2026-06-02 01:57:51 +0000 UTC" firstStartedPulling="2026-06-02 01:57:52.007403363 +0000 UTC m=+81.506947008" lastFinishedPulling="2026-06-02 01:57:53.913835717 +0000 UTC m=+83.413379362" observedRunningTime="2026-06-02 01:57:54.474540001 +0000 UTC m=+83.974083679" watchObservedRunningTime="2026-06-02 01:57:54.474821378 +0000 UTC m=+83.974365044" Jun 02 01:57:55.212484 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:55.212447 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:55.212713 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:55.212507 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:55.212713 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:55.212583 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:55.212713 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.212620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:59.212600607 +0000 UTC m=+88.712144276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : configmap references non-existent config key: service-ca.crt Jun 02 01:57:55.212893 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.212716 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:55.212893 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.212733 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:57:55.212893 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.212790 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls podName:498a1b29-533d-42bf-be7d-6e277149cec6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:59.212770807 +0000 UTC m=+88.712314455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xp764" (UID: "498a1b29-533d-42bf-be7d-6e277149cec6") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:55.212893 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.212810 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:57:59.212799325 +0000 UTC m=+88.712342985 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : secret "router-metrics-certs-default" not found Jun 02 01:57:55.313269 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:55.313224 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:55.313449 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.313376 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:57:55.313449 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:55.313440 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls podName:59c5298d-d284-439c-a11a-f134905d7cc6 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:59.313425556 +0000 UTC m=+88.812969200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-55lr9" (UID: "59c5298d-d284-439c-a11a-f134905d7cc6") : secret "samples-operator-tls" not found Jun 02 01:57:55.447562 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:55.447527 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" event={"ID":"3d630ea1-2147-4486-8a39-8eaa45ffe09c","Type":"ContainerStarted","Data":"90085a539197ac31f396a5ba6e6c659b309f964285a0a533817edecf41a18cfd"} Jun 02 01:57:56.493836 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.493769 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" podStartSLOduration=2.960987325 podStartE2EDuration="5.493746374s" podCreationTimestamp="2026-06-02 01:57:51 +0000 UTC" firstStartedPulling="2026-06-02 01:57:52.044832393 +0000 UTC m=+81.544376039" lastFinishedPulling="2026-06-02 01:57:54.577591418 +0000 UTC m=+84.077135088" observedRunningTime="2026-06-02 01:57:55.485021945 +0000 UTC m=+84.984565611" watchObservedRunningTime="2026-06-02 01:57:56.493746374 +0000 UTC m=+85.993290042" Jun 02 01:57:56.494218 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.493931 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6"] Jun 02 01:57:56.497212 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.497197 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" Jun 02 01:57:56.503966 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.503944 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9glr9\"" Jun 02 01:57:56.504087 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.504008 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 01:57:56.505022 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.505004 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 01:57:56.513572 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.513549 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6"] Jun 02 01:57:56.523912 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.523879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ngp\" (UniqueName: \"kubernetes.io/projected/34900e52-b119-480c-a54e-6055d2b5b081-kube-api-access-d4ngp\") pod \"migrator-96c6f749-prjs6\" (UID: \"34900e52-b119-480c-a54e-6055d2b5b081\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" Jun 02 01:57:56.624550 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.624513 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ngp\" (UniqueName: \"kubernetes.io/projected/34900e52-b119-480c-a54e-6055d2b5b081-kube-api-access-d4ngp\") pod \"migrator-96c6f749-prjs6\" (UID: \"34900e52-b119-480c-a54e-6055d2b5b081\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" Jun 02 01:57:56.642900 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.642873 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ngp\" (UniqueName: \"kubernetes.io/projected/34900e52-b119-480c-a54e-6055d2b5b081-kube-api-access-d4ngp\") pod \"migrator-96c6f749-prjs6\" (UID: \"34900e52-b119-480c-a54e-6055d2b5b081\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" Jun 02 01:57:56.805310 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.805230 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" Jun 02 01:57:56.955171 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:56.955138 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6"] Jun 02 01:57:56.958157 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:57:56.958121 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34900e52_b119_480c_a54e_6055d2b5b081.slice/crio-cf6f5cd2906ade72c129a3f5ae2e0177fcba23467e5af6a3d266f0f13d9cd286 WatchSource:0}: Error finding container cf6f5cd2906ade72c129a3f5ae2e0177fcba23467e5af6a3d266f0f13d9cd286: Status 404 returned error can't find the container with id cf6f5cd2906ade72c129a3f5ae2e0177fcba23467e5af6a3d266f0f13d9cd286 Jun 02 01:57:57.016890 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:57.016865 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tgzrg_9e03de92-1707-4347-9a1a-a8f9d499f853/dns-node-resolver/0.log" Jun 02 01:57:57.452770 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:57.452730 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" event={"ID":"34900e52-b119-480c-a54e-6055d2b5b081","Type":"ContainerStarted","Data":"cf6f5cd2906ade72c129a3f5ae2e0177fcba23467e5af6a3d266f0f13d9cd286"} Jun 02 01:57:58.015353 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:58.015322 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qs9z2_7bc0ef35-081a-4873-9207-121947a1ce06/node-ca/0.log" Jun 02 01:57:58.456698 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:58.456648 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" event={"ID":"34900e52-b119-480c-a54e-6055d2b5b081","Type":"ContainerStarted","Data":"165b3ac19b22168508abadccde61a4446cabad37674097cec753b610160f7892"} Jun 02 01:57:59.244380 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:59.244319 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:59.244399 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:59.244466 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.244531 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:58:07.244506068 +0000 UTC m=+96.744049734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : configmap references non-existent config key: service-ca.crt Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.244545 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.244587 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls podName:498a1b29-533d-42bf-be7d-6e277149cec6 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:07.244575636 +0000 UTC m=+96.744119287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xp764" (UID: "498a1b29-533d-42bf-be7d-6e277149cec6") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.244599 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:57:59.244903 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.244650 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs podName:ec5c3545-2340-400b-8f7d-1cf4d42c08fb nodeName:}" failed. No retries permitted until 2026-06-02 01:58:07.244633856 +0000 UTC m=+96.744177521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs") pod "router-default-54cd7cd9c9-6c8fd" (UID: "ec5c3545-2340-400b-8f7d-1cf4d42c08fb") : secret "router-metrics-certs-default" not found Jun 02 01:57:59.344986 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:59.344956 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:57:59.345139 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.345060 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 01:57:59.345139 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:57:59.345113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls podName:59c5298d-d284-439c-a11a-f134905d7cc6 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:07.345098306 +0000 UTC m=+96.844641951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-55lr9" (UID: "59c5298d-d284-439c-a11a-f134905d7cc6") : secret "samples-operator-tls" not found Jun 02 01:57:59.459970 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:57:59.459929 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" event={"ID":"34900e52-b119-480c-a54e-6055d2b5b081","Type":"ContainerStarted","Data":"020a35f778f246bfddf87a633a99984b741c77ebd671905efd491a47e40b9a07"} Jun 02 01:58:07.305381 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.305335 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:07.305930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.305391 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:58:07.305930 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:07.305483 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 01:58:07.305930 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:07.305530 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls podName:498a1b29-533d-42bf-be7d-6e277149cec6 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:23.305517167 +0000 UTC m=+112.805060812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-xp764" (UID: "498a1b29-533d-42bf-be7d-6e277149cec6") : secret "cluster-monitoring-operator-tls" not found Jun 02 01:58:07.305930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.305634 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:07.306068 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.305937 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-service-ca-bundle\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:07.308074 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.308057 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec5c3545-2340-400b-8f7d-1cf4d42c08fb-metrics-certs\") pod \"router-default-54cd7cd9c9-6c8fd\" (UID: \"ec5c3545-2340-400b-8f7d-1cf4d42c08fb\") " pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:07.333236 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.333205 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:07.406779 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.406748 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:58:07.410270 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.410203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/59c5298d-d284-439c-a11a-f134905d7cc6-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-55lr9\" (UID: \"59c5298d-d284-439c-a11a-f134905d7cc6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:58:07.421158 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.421127 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" Jun 02 01:58:07.468951 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.468648 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-prjs6" podStartSLOduration=10.105192403 podStartE2EDuration="11.468627088s" podCreationTimestamp="2026-06-02 01:57:56 +0000 UTC" firstStartedPulling="2026-06-02 01:57:56.960012583 +0000 UTC m=+86.459556228" lastFinishedPulling="2026-06-02 01:57:58.323447265 +0000 UTC m=+87.822990913" observedRunningTime="2026-06-02 01:57:59.492261687 +0000 UTC m=+88.991805354" watchObservedRunningTime="2026-06-02 01:58:07.468627088 +0000 UTC m=+96.968170755" Jun 02 01:58:07.469912 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.469640 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54cd7cd9c9-6c8fd"] Jun 02 01:58:07.473718 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:07.473686 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5c3545_2340_400b_8f7d_1cf4d42c08fb.slice/crio-a3517c0e1d19017c4c553d430b71d61c00a718c2423f8b6d774e3cea7baa0a4a WatchSource:0}: Error finding container a3517c0e1d19017c4c553d430b71d61c00a718c2423f8b6d774e3cea7baa0a4a: Status 404 returned error can't find the container with id a3517c0e1d19017c4c553d430b71d61c00a718c2423f8b6d774e3cea7baa0a4a Jun 02 01:58:07.478978 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.477574 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" event={"ID":"ec5c3545-2340-400b-8f7d-1cf4d42c08fb","Type":"ContainerStarted","Data":"a3517c0e1d19017c4c553d430b71d61c00a718c2423f8b6d774e3cea7baa0a4a"} Jun 02 01:58:07.553299 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:07.553268 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9"] Jun 02 01:58:08.482303 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.482247 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" event={"ID":"ec5c3545-2340-400b-8f7d-1cf4d42c08fb","Type":"ContainerStarted","Data":"906f76533a9ad0a146b34ddb5a820205e15ed6e20a4b8687fe2d23203126701b"} Jun 02 01:58:08.483517 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.483490 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" event={"ID":"59c5298d-d284-439c-a11a-f134905d7cc6","Type":"ContainerStarted","Data":"85b8d523e7f4fec04c0c877a5a154616ef9363f7ca41de86a3d03ca2d43bdc26"} Jun 02 01:58:08.505273 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.505206 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" podStartSLOduration=17.505190844 podStartE2EDuration="17.505190844s" podCreationTimestamp="2026-06-02 01:57:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:58:08.504506955 +0000 UTC m=+98.004050634" watchObservedRunningTime="2026-06-02 01:58:08.505190844 +0000 UTC m=+98.004734512" Jun 02 01:58:08.818160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.818080 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:58:08.818160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.818127 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:58:08.820430 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.820405 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/00f37939-1151-4303-ad65-604b2fd38d25-metrics-tls\") pod \"dns-default-fmr8x\" (UID: \"00f37939-1151-4303-ad65-604b2fd38d25\") " pod="openshift-dns/dns-default-fmr8x" Jun 02 01:58:08.820630 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.820612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/354a6bea-a69e-4422-b6d2-78d2419bdcc1-cert\") pod \"ingress-canary-flrpl\" (UID: \"354a6bea-a69e-4422-b6d2-78d2419bdcc1\") " pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:58:08.830367 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.830347 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74htp\"" Jun 02 01:58:08.837009 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.836988 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fmr8x" Jun 02 01:58:08.842325 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.842307 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6j559\"" Jun 02 01:58:08.849139 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:08.849116 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-flrpl" Jun 02 01:58:09.334147 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.334113 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:09.337424 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.337399 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:09.400083 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.400057 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-flrpl"] Jun 02 01:58:09.402840 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:09.402812 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354a6bea_a69e_4422_b6d2_78d2419bdcc1.slice/crio-ac1c6b544c975debf39b229d5f5ccc6762a568716bf43eb90dfb6a72e165755d WatchSource:0}: Error finding container ac1c6b544c975debf39b229d5f5ccc6762a568716bf43eb90dfb6a72e165755d: Status 404 returned error can't find the container with id ac1c6b544c975debf39b229d5f5ccc6762a568716bf43eb90dfb6a72e165755d Jun 02 01:58:09.416054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.416032 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fmr8x"] Jun 02 01:58:09.419914 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:09.419888 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f37939_1151_4303_ad65_604b2fd38d25.slice/crio-691209d60d17000aff8b408ce14da4ebb6b574c294719a2f27aab531b3a4bde1 WatchSource:0}: Error finding container 691209d60d17000aff8b408ce14da4ebb6b574c294719a2f27aab531b3a4bde1: Status 404 returned error can't find the container with id 691209d60d17000aff8b408ce14da4ebb6b574c294719a2f27aab531b3a4bde1 Jun 02 01:58:09.488418 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.488384 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" event={"ID":"59c5298d-d284-439c-a11a-f134905d7cc6","Type":"ContainerStarted","Data":"55e28cb3eddad01431b5101f16112b257ebef62b83c661a6abd44155e5555b80"} Jun 02 01:58:09.488863 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.488428 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" event={"ID":"59c5298d-d284-439c-a11a-f134905d7cc6","Type":"ContainerStarted","Data":"9c330a2163a2c8b2085109a9ca6dec44c7aa0be1da9c1efdf483d8f5cdec9473"} Jun 02 01:58:09.490031 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.490006 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-flrpl" event={"ID":"354a6bea-a69e-4422-b6d2-78d2419bdcc1","Type":"ContainerStarted","Data":"ac1c6b544c975debf39b229d5f5ccc6762a568716bf43eb90dfb6a72e165755d"} Jun 02 01:58:09.491236 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.491214 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmr8x" event={"ID":"00f37939-1151-4303-ad65-604b2fd38d25","Type":"ContainerStarted","Data":"691209d60d17000aff8b408ce14da4ebb6b574c294719a2f27aab531b3a4bde1"} Jun 02 01:58:09.491679 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.491640 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:09.493251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.493209 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54cd7cd9c9-6c8fd" Jun 02 01:58:09.510685 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:09.510556 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-55lr9" podStartSLOduration=16.794449505 podStartE2EDuration="18.510539797s" podCreationTimestamp="2026-06-02 01:57:51 +0000 UTC" firstStartedPulling="2026-06-02 01:58:07.603274487 +0000 UTC m=+97.102818136" lastFinishedPulling="2026-06-02 01:58:09.319364781 +0000 UTC m=+98.818908428" observedRunningTime="2026-06-02 01:58:09.509850826 +0000 UTC m=+99.009394496" watchObservedRunningTime="2026-06-02 01:58:09.510539797 +0000 UTC m=+99.010083486" Jun 02 01:58:10.415429 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:10.415397 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zbj67" Jun 02 01:58:11.501818 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:11.501722 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-flrpl" event={"ID":"354a6bea-a69e-4422-b6d2-78d2419bdcc1","Type":"ContainerStarted","Data":"57fe7a1b212a3b17c18b05569b0c79f2aeb9d4d3c2ae1458b7023b33a7d7e601"} Jun 02 01:58:11.503252 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:11.503208 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmr8x" event={"ID":"00f37939-1151-4303-ad65-604b2fd38d25","Type":"ContainerStarted","Data":"8b51e86784fe583f779efe5fb07b0485df296bbd4a5ffc4dfb7b9a10acb82c66"} Jun 02 01:58:11.503252 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:11.503246 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fmr8x" event={"ID":"00f37939-1151-4303-ad65-604b2fd38d25","Type":"ContainerStarted","Data":"cd719e1dd46eb1be61128a271748369b38db8c878e2424c02bca3a5f481f5ed5"} Jun 02 01:58:11.521207 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:11.521164 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-flrpl" podStartSLOduration=65.670054879 podStartE2EDuration="1m7.521148675s" podCreationTimestamp="2026-06-02 01:57:04 +0000 UTC" firstStartedPulling="2026-06-02 01:58:09.404735299 +0000 UTC m=+98.904278944" lastFinishedPulling="2026-06-02 01:58:11.255829092 +0000 UTC m=+100.755372740" observedRunningTime="2026-06-02 01:58:11.520428176 +0000 UTC m=+101.019971844" watchObservedRunningTime="2026-06-02 01:58:11.521148675 +0000 UTC m=+101.020692345" Jun 02 01:58:11.544836 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:11.544797 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fmr8x" podStartSLOduration=65.71954199 podStartE2EDuration="1m7.544784974s" podCreationTimestamp="2026-06-02 01:57:04 +0000 UTC" firstStartedPulling="2026-06-02 01:58:09.427076119 +0000 UTC m=+98.926619764" lastFinishedPulling="2026-06-02 01:58:11.2523191 +0000 UTC m=+100.751862748" observedRunningTime="2026-06-02 01:58:11.543776608 +0000 UTC m=+101.043320268" watchObservedRunningTime="2026-06-02 01:58:11.544784974 +0000 UTC m=+101.044328640" Jun 02 01:58:12.507002 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:12.506971 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fmr8x" Jun 02 01:58:20.836063 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.836027 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-szkfk"] Jun 02 01:58:20.839131 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.839114 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:20.842349 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.842330 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2576q\"" Jun 02 01:58:20.843638 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.843620 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:58:20.843800 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.843675 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:58:20.880061 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.880028 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szkfk"] Jun 02 01:58:20.906162 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.906132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceccd35a-705d-4032-8f98-dc11f5d50f50-data-volume\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:20.906315 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.906174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceccd35a-705d-4032-8f98-dc11f5d50f50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:20.906315 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.906207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceccd35a-705d-4032-8f98-dc11f5d50f50-crio-socket\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:20.906315 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.906275 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceccd35a-705d-4032-8f98-dc11f5d50f50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:20.906315 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:20.906297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvr8v\" (UniqueName: \"kubernetes.io/projected/ceccd35a-705d-4032-8f98-dc11f5d50f50-kube-api-access-qvr8v\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007143 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007109 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceccd35a-705d-4032-8f98-dc11f5d50f50-data-volume\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007143 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007146 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceccd35a-705d-4032-8f98-dc11f5d50f50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007353 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007166 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceccd35a-705d-4032-8f98-dc11f5d50f50-crio-socket\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007353 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007227 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceccd35a-705d-4032-8f98-dc11f5d50f50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007353 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007254 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvr8v\" (UniqueName: \"kubernetes.io/projected/ceccd35a-705d-4032-8f98-dc11f5d50f50-kube-api-access-qvr8v\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007486 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007346 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceccd35a-705d-4032-8f98-dc11f5d50f50-crio-socket\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007486 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceccd35a-705d-4032-8f98-dc11f5d50f50-data-volume\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.007760 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.007734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceccd35a-705d-4032-8f98-dc11f5d50f50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.009740 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.009719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceccd35a-705d-4032-8f98-dc11f5d50f50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.031016 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.030990 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvr8v\" (UniqueName: \"kubernetes.io/projected/ceccd35a-705d-4032-8f98-dc11f5d50f50-kube-api-access-qvr8v\") pod \"insights-runtime-extractor-szkfk\" (UID: \"ceccd35a-705d-4032-8f98-dc11f5d50f50\") " pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.147922 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.147898 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szkfk" Jun 02 01:58:21.280254 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.280220 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szkfk"] Jun 02 01:58:21.283501 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:21.283479 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceccd35a_705d_4032_8f98_dc11f5d50f50.slice/crio-e803024858ed54b2a3e21d0bca67506c1891bc84b2ed4b2f1ea9ea874993e78d WatchSource:0}: Error finding container e803024858ed54b2a3e21d0bca67506c1891bc84b2ed4b2f1ea9ea874993e78d: Status 404 returned error can't find the container with id e803024858ed54b2a3e21d0bca67506c1891bc84b2ed4b2f1ea9ea874993e78d Jun 02 01:58:21.532898 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.532811 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szkfk" event={"ID":"ceccd35a-705d-4032-8f98-dc11f5d50f50","Type":"ContainerStarted","Data":"19b0cb30c88483c8bc468922d15bd414cb00b2fdf065b5556955992cb007c599"} Jun 02 01:58:21.532898 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:21.532847 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szkfk" event={"ID":"ceccd35a-705d-4032-8f98-dc11f5d50f50","Type":"ContainerStarted","Data":"e803024858ed54b2a3e21d0bca67506c1891bc84b2ed4b2f1ea9ea874993e78d"} Jun 02 01:58:22.512183 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:22.512153 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fmr8x" Jun 02 01:58:22.537227 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:22.537186 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szkfk" event={"ID":"ceccd35a-705d-4032-8f98-dc11f5d50f50","Type":"ContainerStarted","Data":"f3818df961eb1a23100dd01f1b5272e40940db15d150a940a35f55a13a67dbf6"} Jun 02 01:58:23.326269 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:23.326232 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:58:23.328638 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:23.328619 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/498a1b29-533d-42bf-be7d-6e277149cec6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-xp764\" (UID: \"498a1b29-533d-42bf-be7d-6e277149cec6\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:58:23.518507 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:23.518471 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" Jun 02 01:58:23.541785 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:23.541749 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szkfk" event={"ID":"ceccd35a-705d-4032-8f98-dc11f5d50f50","Type":"ContainerStarted","Data":"811b3b7836c8d8d55252c01c5b14d02c785d69733298bbfe3d7c09ba7a2514f7"} Jun 02 01:58:23.563215 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:23.563165 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-szkfk" podStartSLOduration=1.525333864 podStartE2EDuration="3.563149584s" podCreationTimestamp="2026-06-02 01:58:20 +0000 UTC" firstStartedPulling="2026-06-02 01:58:21.338631741 +0000 UTC m=+110.838175393" lastFinishedPulling="2026-06-02 01:58:23.376447468 +0000 UTC m=+112.875991113" observedRunningTime="2026-06-02 01:58:23.562230823 +0000 UTC m=+113.061774490" watchObservedRunningTime="2026-06-02 01:58:23.563149584 +0000 UTC m=+113.062693251" Jun 02 01:58:23.645800 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:23.645777 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764"] Jun 02 01:58:23.647868 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:23.647841 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498a1b29_533d_42bf_be7d_6e277149cec6.slice/crio-bab25f3b7dd443c72048f7c0f2bc1936c3c06f708b7b072e3d01626e9ed72acf WatchSource:0}: Error finding container bab25f3b7dd443c72048f7c0f2bc1936c3c06f708b7b072e3d01626e9ed72acf: Status 404 returned error can't find the container with id bab25f3b7dd443c72048f7c0f2bc1936c3c06f708b7b072e3d01626e9ed72acf Jun 02 01:58:24.546055 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:24.546016 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" event={"ID":"498a1b29-533d-42bf-be7d-6e277149cec6","Type":"ContainerStarted","Data":"bab25f3b7dd443c72048f7c0f2bc1936c3c06f708b7b072e3d01626e9ed72acf"} Jun 02 01:58:26.124951 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.124920 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf"] Jun 02 01:58:26.147021 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.146993 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf"] Jun 02 01:58:26.147160 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.147103 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:26.149887 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.149865 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 01:58:26.149992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.149894 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-82678\"" Jun 02 01:58:26.249973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.249927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9042b37-bc2f-4b01-9ef9-9da1011377f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-v4fzf\" (UID: \"d9042b37-bc2f-4b01-9ef9-9da1011377f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:26.350973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.350933 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9042b37-bc2f-4b01-9ef9-9da1011377f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-v4fzf\" (UID: \"d9042b37-bc2f-4b01-9ef9-9da1011377f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:26.351146 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:26.351069 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:58:26.351146 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:26.351138 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9042b37-bc2f-4b01-9ef9-9da1011377f7-tls-certificates podName:d9042b37-bc2f-4b01-9ef9-9da1011377f7 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:26.851122244 +0000 UTC m=+116.350665889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d9042b37-bc2f-4b01-9ef9-9da1011377f7-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-v4fzf" (UID: "d9042b37-bc2f-4b01-9ef9-9da1011377f7") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:58:26.551395 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.551315 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" event={"ID":"498a1b29-533d-42bf-be7d-6e277149cec6","Type":"ContainerStarted","Data":"9d1dc2fc4e991fd55677758d339e34df6168417fec3f1608251eab790f350292"} Jun 02 01:58:26.575236 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.575188 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-xp764" podStartSLOduration=33.688936732 podStartE2EDuration="35.575174125s" podCreationTimestamp="2026-06-02 01:57:51 +0000 UTC" firstStartedPulling="2026-06-02 01:58:23.649680973 +0000 UTC m=+113.149224619" lastFinishedPulling="2026-06-02 01:58:25.53591836 +0000 UTC m=+115.035462012" observedRunningTime="2026-06-02 01:58:26.574902619 +0000 UTC m=+116.074446287" watchObservedRunningTime="2026-06-02 01:58:26.575174125 +0000 UTC m=+116.074717807" Jun 02 01:58:26.854900 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.854860 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9042b37-bc2f-4b01-9ef9-9da1011377f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-v4fzf\" (UID: \"d9042b37-bc2f-4b01-9ef9-9da1011377f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:26.857324 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:26.857298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d9042b37-bc2f-4b01-9ef9-9da1011377f7-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-v4fzf\" (UID: \"d9042b37-bc2f-4b01-9ef9-9da1011377f7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:27.055881 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:27.055848 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:27.175887 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:27.175850 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf"] Jun 02 01:58:27.179638 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:27.179610 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9042b37_bc2f_4b01_9ef9_9da1011377f7.slice/crio-d528956365fc6052baf4ea5b3e21a7ee02be21af5e474ddf60028ff534aae341 WatchSource:0}: Error finding container d528956365fc6052baf4ea5b3e21a7ee02be21af5e474ddf60028ff534aae341: Status 404 returned error can't find the container with id d528956365fc6052baf4ea5b3e21a7ee02be21af5e474ddf60028ff534aae341 Jun 02 01:58:27.554868 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:27.554791 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" event={"ID":"d9042b37-bc2f-4b01-9ef9-9da1011377f7","Type":"ContainerStarted","Data":"d528956365fc6052baf4ea5b3e21a7ee02be21af5e474ddf60028ff534aae341"} Jun 02 01:58:28.558642 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:28.558560 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" event={"ID":"d9042b37-bc2f-4b01-9ef9-9da1011377f7","Type":"ContainerStarted","Data":"7166d1dd41b5e883061f229d9c6a226f33a9186eb1ad7e5f42cdcda3ecdbb09b"} Jun 02 01:58:28.559697 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:28.558781 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:28.563434 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:28.563413 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" Jun 02 01:58:28.578592 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:28.578548 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-v4fzf" podStartSLOduration=1.5820713720000001 podStartE2EDuration="2.578534816s" podCreationTimestamp="2026-06-02 01:58:26 +0000 UTC" firstStartedPulling="2026-06-02 01:58:27.181603111 +0000 UTC m=+116.681146772" lastFinishedPulling="2026-06-02 01:58:28.178066568 +0000 UTC m=+117.677610216" observedRunningTime="2026-06-02 01:58:28.578218295 +0000 UTC m=+118.077761962" watchObservedRunningTime="2026-06-02 01:58:28.578534816 +0000 UTC m=+118.078078483" Jun 02 01:58:29.223286 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.223251 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8"] Jun 02 01:58:29.226301 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.226286 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.229959 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.229940 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 01:58:29.230053 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.229946 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 01:58:29.231511 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.231486 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-t8dqw\"" Jun 02 01:58:29.231631 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.231533 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:58:29.238301 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.238259 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8"] Jun 02 01:58:29.375734 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.375704 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9eb4784-1023-478c-b413-20cddd537896-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.375899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.375745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.375899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.375767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsx8f\" (UniqueName: \"kubernetes.io/projected/c9eb4784-1023-478c-b413-20cddd537896-kube-api-access-lsx8f\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.375899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.375834 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.476428 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.476339 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9eb4784-1023-478c-b413-20cddd537896-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.476428 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.476395 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.476428 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.476424 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsx8f\" (UniqueName: \"kubernetes.io/projected/c9eb4784-1023-478c-b413-20cddd537896-kube-api-access-lsx8f\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.476640 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.476458 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.476640 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:29.476582 2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 02 01:58:29.476743 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:29.476698 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-tls podName:c9eb4784-1023-478c-b413-20cddd537896 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:29.97665213 +0000 UTC m=+119.476195774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-tls") pod "prometheus-operator-658bcd8bdf-nwgd8" (UID: "c9eb4784-1023-478c-b413-20cddd537896") : secret "prometheus-operator-tls" not found Jun 02 01:58:29.477138 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.477115 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9eb4784-1023-478c-b413-20cddd537896-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.478984 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.478967 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.489152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.489131 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsx8f\" (UniqueName: \"kubernetes.io/projected/c9eb4784-1023-478c-b413-20cddd537896-kube-api-access-lsx8f\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.979484 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.979443 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:29.981978 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:29.981953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c9eb4784-1023-478c-b413-20cddd537896-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-nwgd8\" (UID: \"c9eb4784-1023-478c-b413-20cddd537896\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:30.134776 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:30.134731 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" Jun 02 01:58:30.263053 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:30.263027 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8"] Jun 02 01:58:30.264280 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:30.264251 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9eb4784_1023_478c_b413_20cddd537896.slice/crio-6e912ce1aeab7117233383bb3aaf7414f6ac6cbee25630ed3313b5b0128d2b94 WatchSource:0}: Error finding container 6e912ce1aeab7117233383bb3aaf7414f6ac6cbee25630ed3313b5b0128d2b94: Status 404 returned error can't find the container with id 6e912ce1aeab7117233383bb3aaf7414f6ac6cbee25630ed3313b5b0128d2b94 Jun 02 01:58:30.564926 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:30.564848 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" event={"ID":"c9eb4784-1023-478c-b413-20cddd537896","Type":"ContainerStarted","Data":"6e912ce1aeab7117233383bb3aaf7414f6ac6cbee25630ed3313b5b0128d2b94"} Jun 02 01:58:31.569603 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:31.569570 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" event={"ID":"c9eb4784-1023-478c-b413-20cddd537896","Type":"ContainerStarted","Data":"df4dbaa46fafc869f3e2a961153407408a36238e0c9e6c2edc0aac65d6506a61"} Jun 02 01:58:31.569919 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:31.569616 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" event={"ID":"c9eb4784-1023-478c-b413-20cddd537896","Type":"ContainerStarted","Data":"8ed3f1b933c38c3308f93c8a9d03bf94084f95ba4c448d6b2500403735afcb35"} Jun 02 01:58:31.591578 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:31.591535 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-nwgd8" podStartSLOduration=1.419593607 podStartE2EDuration="2.591517648s" podCreationTimestamp="2026-06-02 01:58:29 +0000 UTC" firstStartedPulling="2026-06-02 01:58:30.266102477 +0000 UTC m=+119.765646121" lastFinishedPulling="2026-06-02 01:58:31.4380265 +0000 UTC m=+120.937570162" observedRunningTime="2026-06-02 01:58:31.590789396 +0000 UTC m=+121.090333063" watchObservedRunningTime="2026-06-02 01:58:31.591517648 +0000 UTC m=+121.091061314" Jun 02 01:58:33.652057 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.652021 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bt4ll"] Jun 02 01:58:33.658499 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.658471 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.658641 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.658480 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bfbs9"] Jun 02 01:58:33.661152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.661121 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 01:58:33.661257 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.661241 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:58:33.661474 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.661462 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qlw5n\"" Jun 02 01:58:33.662395 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.662377 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.665996 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.665960 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:58:33.666804 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.666787 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:58:33.667590 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.667569 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:58:33.670422 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.670404 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5rt26\"" Jun 02 01:58:33.674493 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.674474 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bt4ll"] Jun 02 01:58:33.809189 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-sys\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809346 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.809346 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.809346 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-textfile\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809346 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5878929c-a72b-44a0-ad5c-5aaf87d886af-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.809475 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j9cz\" (UniqueName: \"kubernetes.io/projected/1e70e50c-7a22-4b26-ab22-2f8dd349105a-kube-api-access-6j9cz\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809475 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809402 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809475 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809427 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809475 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-tls\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809591 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809475 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-root\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809591 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e70e50c-7a22-4b26-ab22-2f8dd349105a-metrics-client-ca\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.809591 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809553 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rdsc\" (UniqueName: \"kubernetes.io/projected/5878929c-a72b-44a0-ad5c-5aaf87d886af-kube-api-access-7rdsc\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.809591 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.809574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-wtmp\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910254 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910175 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-textfile\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910254 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910214 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5878929c-a72b-44a0-ad5c-5aaf87d886af-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.910254 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910234 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6j9cz\" (UniqueName: \"kubernetes.io/projected/1e70e50c-7a22-4b26-ab22-2f8dd349105a-kube-api-access-6j9cz\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910460 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910374 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910460 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910420 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910460 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910449 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-tls\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910684 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910486 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-root\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910684 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910499 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-textfile\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910684 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910565 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-root\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910684 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910566 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e70e50c-7a22-4b26-ab22-2f8dd349105a-metrics-client-ca\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910684 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910616 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7rdsc\" (UniqueName: \"kubernetes.io/projected/5878929c-a72b-44a0-ad5c-5aaf87d886af-kube-api-access-7rdsc\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910685 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-wtmp\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:33.910618 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910738 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-sys\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:33.910774 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-tls podName:1e70e50c-7a22-4b26-ab22-2f8dd349105a nodeName:}" failed. No retries permitted until 2026-06-02 01:58:34.41074873 +0000 UTC m=+123.910292388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-tls") pod "node-exporter-bfbs9" (UID: "1e70e50c-7a22-4b26-ab22-2f8dd349105a") : secret "node-exporter-tls" not found Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910814 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910849 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.910924 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.910892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-wtmp\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.911224 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:33.911002 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 01:58:33.911224 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:58:33.911064 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-tls podName:5878929c-a72b-44a0-ad5c-5aaf87d886af nodeName:}" failed. No retries permitted until 2026-06-02 01:58:34.411045809 +0000 UTC m=+123.910589471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-bt4ll" (UID: "5878929c-a72b-44a0-ad5c-5aaf87d886af") : secret "openshift-state-metrics-tls" not found Jun 02 01:58:33.911224 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.911003 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5878929c-a72b-44a0-ad5c-5aaf87d886af-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.911224 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.911062 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e70e50c-7a22-4b26-ab22-2f8dd349105a-sys\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.911224 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.911108 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1e70e50c-7a22-4b26-ab22-2f8dd349105a-metrics-client-ca\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.911224 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.911116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.912903 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.912886 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.913176 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.913159 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:33.923161 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.923133 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j9cz\" (UniqueName: \"kubernetes.io/projected/1e70e50c-7a22-4b26-ab22-2f8dd349105a-kube-api-access-6j9cz\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:33.933290 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:33.933258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rdsc\" (UniqueName: \"kubernetes.io/projected/5878929c-a72b-44a0-ad5c-5aaf87d886af-kube-api-access-7rdsc\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:34.415811 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.415773 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-tls\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:34.416013 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.415860 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:34.418747 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.418725 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5878929c-a72b-44a0-ad5c-5aaf87d886af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bt4ll\" (UID: \"5878929c-a72b-44a0-ad5c-5aaf87d886af\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:34.418856 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.418774 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1e70e50c-7a22-4b26-ab22-2f8dd349105a-node-exporter-tls\") pod \"node-exporter-bfbs9\" (UID: \"1e70e50c-7a22-4b26-ab22-2f8dd349105a\") " pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:34.569139 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.569104 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" Jun 02 01:58:34.573919 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.573890 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bfbs9" Jun 02 01:58:34.583451 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:34.583424 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e70e50c_7a22_4b26_ab22_2f8dd349105a.slice/crio-bdf50fbe3d19b26a3f2c73a276180106199cd94baf33e8a5e3e73113ff845f7e WatchSource:0}: Error finding container bdf50fbe3d19b26a3f2c73a276180106199cd94baf33e8a5e3e73113ff845f7e: Status 404 returned error can't find the container with id bdf50fbe3d19b26a3f2c73a276180106199cd94baf33e8a5e3e73113ff845f7e Jun 02 01:58:34.705391 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.705313 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:58:34.711215 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.711192 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.714276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714084 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 01:58:34.714276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714146 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 01:58:34.714276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714164 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 01:58:34.714276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714203 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 01:58:34.714561 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714390 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m7zzm\"" Jun 02 01:58:34.714561 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714492 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 01:58:34.714561 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714520 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 01:58:34.715280 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714714 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 01:58:34.715280 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.714784 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 01:58:34.718556 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.718509 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bt4ll"] Jun 02 01:58:34.722798 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:34.722777 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5878929c_a72b_44a0_ad5c_5aaf87d886af.slice/crio-975cb283748dd9861d58c89550f350221052a4cb5dd087e1835cb92cf6d33a47 WatchSource:0}: Error finding container 975cb283748dd9861d58c89550f350221052a4cb5dd087e1835cb92cf6d33a47: Status 404 returned error can't find the container with id 975cb283748dd9861d58c89550f350221052a4cb5dd087e1835cb92cf6d33a47 Jun 02 01:58:34.726223 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.726176 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:58:34.726223 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.726210 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 01:58:34.819994 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.819964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820102 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820102 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820056 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-out\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820102 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820081 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820257 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lwxr\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-kube-api-access-5lwxr\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820257 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-web-config\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820257 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820402 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820258 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820402 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820402 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820402 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820588 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.820588 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.820434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.921614 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921577 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.921791 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921624 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.921791 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921681 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-out\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.921791 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921706 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.921791 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921733 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lwxr\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-kube-api-access-5lwxr\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.921791 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921759 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-web-config\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921793 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921828 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921880 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921915 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921939 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.921995 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.922054 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.922028 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.923406 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.922791 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.923406 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.922809 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.923406 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.923007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.925146 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.925111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927117 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.926718 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-out\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927117 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.926741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927117 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.926781 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-web-config\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927117 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.927078 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927117 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.927084 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927539 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.927517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-volume\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.927876 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.927844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.928283 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.928267 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:34.932030 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:34.932007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lwxr\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-kube-api-access-5lwxr\") pod \"alertmanager-main-0\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:35.026091 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.026015 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:58:35.175454 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.175422 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:58:35.179542 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:35.179514 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccc143c_ca5f_41a8_b046_de19c39e0559.slice/crio-f57f6fdbbc4b698bccf94a89cc5b0d7847a0af553ed4f8cce7850ab19bd4de90 WatchSource:0}: Error finding container f57f6fdbbc4b698bccf94a89cc5b0d7847a0af553ed4f8cce7850ab19bd4de90: Status 404 returned error can't find the container with id f57f6fdbbc4b698bccf94a89cc5b0d7847a0af553ed4f8cce7850ab19bd4de90 Jun 02 01:58:35.582293 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.582260 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" event={"ID":"5878929c-a72b-44a0-ad5c-5aaf87d886af","Type":"ContainerStarted","Data":"573bb5a0c1678f2e4356631d162ade0f8f6d6bee03f5f2a703d6d62a7f2d4b28"} Jun 02 01:58:35.582408 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.582305 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" event={"ID":"5878929c-a72b-44a0-ad5c-5aaf87d886af","Type":"ContainerStarted","Data":"dbf9fbac089c3343b56a01f62183467038d7118e99d135ebe0c31d5deb598b3c"} Jun 02 01:58:35.582408 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.582318 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" event={"ID":"5878929c-a72b-44a0-ad5c-5aaf87d886af","Type":"ContainerStarted","Data":"975cb283748dd9861d58c89550f350221052a4cb5dd087e1835cb92cf6d33a47"} Jun 02 01:58:35.583489 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.583450 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"f57f6fdbbc4b698bccf94a89cc5b0d7847a0af553ed4f8cce7850ab19bd4de90"} Jun 02 01:58:35.584651 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:35.584623 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfbs9" event={"ID":"1e70e50c-7a22-4b26-ab22-2f8dd349105a","Type":"ContainerStarted","Data":"bdf50fbe3d19b26a3f2c73a276180106199cd94baf33e8a5e3e73113ff845f7e"} Jun 02 01:58:36.590470 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:36.590428 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" event={"ID":"5878929c-a72b-44a0-ad5c-5aaf87d886af","Type":"ContainerStarted","Data":"072b9b48e345e5b8f1262d70103a0ace7713ae40ba3819dab54ef91827be6f22"} Jun 02 01:58:36.593063 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:36.593029 2579 generic.go:358] "Generic (PLEG): container finished" podID="1e70e50c-7a22-4b26-ab22-2f8dd349105a" containerID="4d5a67e18a48d42ad7b183b865569748b536851415f6e947c2e0c5d3eab62ef5" exitCode=0 Jun 02 01:58:36.593191 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:36.593107 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfbs9" event={"ID":"1e70e50c-7a22-4b26-ab22-2f8dd349105a","Type":"ContainerDied","Data":"4d5a67e18a48d42ad7b183b865569748b536851415f6e947c2e0c5d3eab62ef5"} Jun 02 01:58:36.615849 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:36.615485 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-bt4ll" podStartSLOduration=2.557213584 podStartE2EDuration="3.615464587s" podCreationTimestamp="2026-06-02 01:58:33 +0000 UTC" firstStartedPulling="2026-06-02 01:58:34.87167569 +0000 UTC m=+124.371219347" lastFinishedPulling="2026-06-02 01:58:35.929926705 +0000 UTC m=+125.429470350" observedRunningTime="2026-06-02 01:58:36.614460933 +0000 UTC m=+126.114004601" watchObservedRunningTime="2026-06-02 01:58:36.615464587 +0000 UTC m=+126.115008256" Jun 02 01:58:37.596904 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:37.596865 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61" exitCode=0 Jun 02 01:58:37.597327 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:37.596951 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61"} Jun 02 01:58:37.599045 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:37.599018 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfbs9" event={"ID":"1e70e50c-7a22-4b26-ab22-2f8dd349105a","Type":"ContainerStarted","Data":"becd1cb857fcdb2145e969da2c8048ddbacdaa8efa6b1806345e5886a7d8d337"} Jun 02 01:58:37.599124 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:37.599053 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bfbs9" event={"ID":"1e70e50c-7a22-4b26-ab22-2f8dd349105a","Type":"ContainerStarted","Data":"2a14397aa6e48a451d6488e49399a54d9a4f337dffe9ab5a40a9bc5343e43ac0"} Jun 02 01:58:38.393961 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.393906 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bfbs9" podStartSLOduration=4.405379168 podStartE2EDuration="5.393889842s" podCreationTimestamp="2026-06-02 01:58:33 +0000 UTC" firstStartedPulling="2026-06-02 01:58:34.585872178 +0000 UTC m=+124.085415839" lastFinishedPulling="2026-06-02 01:58:35.574382865 +0000 UTC m=+125.073926513" observedRunningTime="2026-06-02 01:58:37.662779959 +0000 UTC m=+127.162323623" watchObservedRunningTime="2026-06-02 01:58:38.393889842 +0000 UTC m=+127.893433517" Jun 02 01:58:38.394843 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.394825 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6"] Jun 02 01:58:38.398064 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.398049 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:38.402129 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.402095 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 01:58:38.402263 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.402109 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-c5wzz\"" Jun 02 01:58:38.406384 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.406321 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6"] Jun 02 01:58:38.553339 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.553304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/da4d2cd8-328e-4b83-a70f-89223cd3488b-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-frtz6\" (UID: \"da4d2cd8-328e-4b83-a70f-89223cd3488b\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:38.654501 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.654415 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/da4d2cd8-328e-4b83-a70f-89223cd3488b-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-frtz6\" (UID: \"da4d2cd8-328e-4b83-a70f-89223cd3488b\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:38.657357 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.657322 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/da4d2cd8-328e-4b83-a70f-89223cd3488b-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-frtz6\" (UID: \"da4d2cd8-328e-4b83-a70f-89223cd3488b\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:38.713780 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.713751 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:38.855786 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:38.855630 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6"] Jun 02 01:58:39.186245 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:39.186214 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4d2cd8_328e_4b83_a70f_89223cd3488b.slice/crio-1ae13dc2676844688bb5e1a9a5866b2dbe77cb35afc0d021c9fb9b04acd7feca WatchSource:0}: Error finding container 1ae13dc2676844688bb5e1a9a5866b2dbe77cb35afc0d021c9fb9b04acd7feca: Status 404 returned error can't find the container with id 1ae13dc2676844688bb5e1a9a5866b2dbe77cb35afc0d021c9fb9b04acd7feca Jun 02 01:58:39.608020 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.607975 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b"} Jun 02 01:58:39.608195 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.608029 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e"} Jun 02 01:58:39.608195 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.608044 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d"} Jun 02 01:58:39.608195 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.608057 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d"} Jun 02 01:58:39.608195 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.608071 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910"} Jun 02 01:58:39.609043 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.609019 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" event={"ID":"da4d2cd8-328e-4b83-a70f-89223cd3488b","Type":"ContainerStarted","Data":"1ae13dc2676844688bb5e1a9a5866b2dbe77cb35afc0d021c9fb9b04acd7feca"} Jun 02 01:58:39.864177 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.864135 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:58:39.866975 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.866948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8279cd15-4d48-4db4-9f0a-6f96b3a21c2d-metrics-certs\") pod \"network-metrics-daemon-gkmb5\" (UID: \"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d\") " pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:58:39.922715 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.922677 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bqdvw\"" Jun 02 01:58:39.931569 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:39.931068 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gkmb5" Jun 02 01:58:40.116747 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:40.116244 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gkmb5"] Jun 02 01:58:40.120869 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:40.120073 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8279cd15_4d48_4db4_9f0a_6f96b3a21c2d.slice/crio-92e34ca72952a7a7946c68ce31d1a1fd8a366d100da230a0180feb780c500bc9 WatchSource:0}: Error finding container 92e34ca72952a7a7946c68ce31d1a1fd8a366d100da230a0180feb780c500bc9: Status 404 returned error can't find the container with id 92e34ca72952a7a7946c68ce31d1a1fd8a366d100da230a0180feb780c500bc9 Jun 02 01:58:40.613056 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:40.613019 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkmb5" event={"ID":"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d","Type":"ContainerStarted","Data":"92e34ca72952a7a7946c68ce31d1a1fd8a366d100da230a0180feb780c500bc9"} Jun 02 01:58:41.618267 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.618230 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerStarted","Data":"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e"} Jun 02 01:58:41.619490 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.619468 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" event={"ID":"da4d2cd8-328e-4b83-a70f-89223cd3488b","Type":"ContainerStarted","Data":"ce8419c035e322456101a98666d00e3f084eb7a51348dbddaf233baaed298732"} Jun 02 01:58:41.619717 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.619699 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:41.621112 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.621094 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkmb5" event={"ID":"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d","Type":"ContainerStarted","Data":"a9c93e7f2477f6b01fe879c4926dfb34ea4bb15bdef7d474040ce4c94b7a0c1d"} Jun 02 01:58:41.621184 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.621117 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gkmb5" event={"ID":"8279cd15-4d48-4db4-9f0a-6f96b3a21c2d","Type":"ContainerStarted","Data":"6e1a3f64ae1a80cf0c32074ce783e203289d745d559091f9a59678989d388832"} Jun 02 01:58:41.625368 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.625351 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" Jun 02 01:58:41.648696 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.648631 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.114574169 podStartE2EDuration="7.648620535s" podCreationTimestamp="2026-06-02 01:58:34 +0000 UTC" firstStartedPulling="2026-06-02 01:58:35.181848692 +0000 UTC m=+124.681392338" lastFinishedPulling="2026-06-02 01:58:40.715895056 +0000 UTC m=+130.215438704" observedRunningTime="2026-06-02 01:58:41.647001812 +0000 UTC m=+131.146545460" watchObservedRunningTime="2026-06-02 01:58:41.648620535 +0000 UTC m=+131.148164254" Jun 02 01:58:41.666810 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.666767 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-frtz6" podStartSLOduration=2.13683206 podStartE2EDuration="3.666752285s" podCreationTimestamp="2026-06-02 01:58:38 +0000 UTC" firstStartedPulling="2026-06-02 01:58:39.188565201 +0000 UTC m=+128.688108849" lastFinishedPulling="2026-06-02 01:58:40.718485415 +0000 UTC m=+130.218029074" observedRunningTime="2026-06-02 01:58:41.665706358 +0000 UTC m=+131.165250028" watchObservedRunningTime="2026-06-02 01:58:41.666752285 +0000 UTC m=+131.166295952" Jun 02 01:58:41.684926 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:41.684870 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gkmb5" podStartSLOduration=129.481405318 podStartE2EDuration="2m10.684853871s" podCreationTimestamp="2026-06-02 01:56:31 +0000 UTC" firstStartedPulling="2026-06-02 01:58:40.122883986 +0000 UTC m=+129.622427646" lastFinishedPulling="2026-06-02 01:58:41.326332551 +0000 UTC m=+130.825876199" observedRunningTime="2026-06-02 01:58:41.683427254 +0000 UTC m=+131.182970922" watchObservedRunningTime="2026-06-02 01:58:41.684853871 +0000 UTC m=+131.184397546" Jun 02 01:58:49.412009 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.411972 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-p86kn"] Jun 02 01:58:49.415276 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.415259 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:58:49.419085 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.419038 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:58:49.419255 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.419099 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:58:49.419401 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.419387 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7x2vr\"" Jun 02 01:58:49.426829 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.426807 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-p86kn"] Jun 02 01:58:49.548169 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.548137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2tjn\" (UniqueName: \"kubernetes.io/projected/d027c761-42a9-46f8-84f1-9bf70b5c508f-kube-api-access-b2tjn\") pod \"downloads-c65b8dc4b-p86kn\" (UID: \"d027c761-42a9-46f8-84f1-9bf70b5c508f\") " pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:58:49.648768 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.648735 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2tjn\" (UniqueName: \"kubernetes.io/projected/d027c761-42a9-46f8-84f1-9bf70b5c508f-kube-api-access-b2tjn\") pod \"downloads-c65b8dc4b-p86kn\" (UID: \"d027c761-42a9-46f8-84f1-9bf70b5c508f\") " pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:58:49.659120 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.659094 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2tjn\" (UniqueName: \"kubernetes.io/projected/d027c761-42a9-46f8-84f1-9bf70b5c508f-kube-api-access-b2tjn\") pod \"downloads-c65b8dc4b-p86kn\" (UID: \"d027c761-42a9-46f8-84f1-9bf70b5c508f\") " pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:58:49.724072 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.723990 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:58:49.856064 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:49.856031 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-p86kn"] Jun 02 01:58:49.858961 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:49.858914 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd027c761_42a9_46f8_84f1_9bf70b5c508f.slice/crio-fb7edfad06b11ce3b90bc2d965697fb4241f61c1ab18bb55f8db18eb4703fef4 WatchSource:0}: Error finding container fb7edfad06b11ce3b90bc2d965697fb4241f61c1ab18bb55f8db18eb4703fef4: Status 404 returned error can't find the container with id fb7edfad06b11ce3b90bc2d965697fb4241f61c1ab18bb55f8db18eb4703fef4 Jun 02 01:58:50.648501 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:50.648457 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-p86kn" event={"ID":"d027c761-42a9-46f8-84f1-9bf70b5c508f","Type":"ContainerStarted","Data":"fb7edfad06b11ce3b90bc2d965697fb4241f61c1ab18bb55f8db18eb4703fef4"} Jun 02 01:58:52.737333 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.737294 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-777966c6b7-wx4tx"] Jun 02 01:58:52.741366 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.741343 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.745902 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.745871 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:58:52.746020 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.745931 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:58:52.746020 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.745955 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:58:52.746210 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.746194 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:58:52.746270 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.746221 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kl7t4\"" Jun 02 01:58:52.746371 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.746354 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:58:52.749321 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.749298 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777966c6b7-wx4tx"] Jun 02 01:58:52.872540 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.872497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-console-config\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.872743 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.872552 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-oauth-config\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.872743 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.872581 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-service-ca\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.872743 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.872602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-serving-cert\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.872743 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.872638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqxc\" (UniqueName: \"kubernetes.io/projected/a668840a-77a0-4079-857a-fe10a87afc25-kube-api-access-tfqxc\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.872743 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.872684 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-oauth-serving-cert\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.973455 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.973414 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-console-config\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.973645 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.973469 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-oauth-config\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.973645 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.973496 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-service-ca\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.973645 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.973520 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-serving-cert\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.973645 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.973548 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqxc\" (UniqueName: \"kubernetes.io/projected/a668840a-77a0-4079-857a-fe10a87afc25-kube-api-access-tfqxc\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.973899 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.973707 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-oauth-serving-cert\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.974323 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.974300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-console-config\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.974421 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.974300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-service-ca\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.974482 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.974421 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-oauth-serving-cert\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.976823 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.976802 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-serving-cert\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.976912 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.976860 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-oauth-config\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:52.987491 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:52.987435 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqxc\" (UniqueName: \"kubernetes.io/projected/a668840a-77a0-4079-857a-fe10a87afc25-kube-api-access-tfqxc\") pod \"console-777966c6b7-wx4tx\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:53.059543 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:53.059509 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:58:53.219827 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:53.219776 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-777966c6b7-wx4tx"] Jun 02 01:58:53.222425 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:58:53.222392 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda668840a_77a0_4079_857a_fe10a87afc25.slice/crio-4f50615ab582ae22bfc853581ba1ea96ff477df783fdb2d929043c580abaf8a0 WatchSource:0}: Error finding container 4f50615ab582ae22bfc853581ba1ea96ff477df783fdb2d929043c580abaf8a0: Status 404 returned error can't find the container with id 4f50615ab582ae22bfc853581ba1ea96ff477df783fdb2d929043c580abaf8a0 Jun 02 01:58:53.659164 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:53.659131 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777966c6b7-wx4tx" event={"ID":"a668840a-77a0-4079-857a-fe10a87afc25","Type":"ContainerStarted","Data":"4f50615ab582ae22bfc853581ba1ea96ff477df783fdb2d929043c580abaf8a0"} Jun 02 01:58:56.671787 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:56.671753 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777966c6b7-wx4tx" event={"ID":"a668840a-77a0-4079-857a-fe10a87afc25","Type":"ContainerStarted","Data":"3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17"} Jun 02 01:58:56.690930 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:58:56.690857 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-777966c6b7-wx4tx" podStartSLOduration=1.596039955 podStartE2EDuration="4.690836407s" podCreationTimestamp="2026-06-02 01:58:52 +0000 UTC" firstStartedPulling="2026-06-02 01:58:53.224568618 +0000 UTC m=+142.724112279" lastFinishedPulling="2026-06-02 01:58:56.319365083 +0000 UTC m=+145.818908731" observedRunningTime="2026-06-02 01:58:56.689373402 +0000 UTC m=+146.188917070" watchObservedRunningTime="2026-06-02 01:58:56.690836407 +0000 UTC m=+146.190380091" Jun 02 01:59:01.931821 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:01.931770 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-db8b4c96b-4k9kc"] Jun 02 01:59:01.938042 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:01.938019 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:01.948794 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:01.948582 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:59:01.949718 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:01.949692 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8b4c96b-4k9kc"] Jun 02 01:59:02.060353 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-service-ca\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.060518 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060391 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-oauth-serving-cert\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.060518 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-serving-cert\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.060518 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060456 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-trusted-ca-bundle\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.060518 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-config\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.060648 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q45x8\" (UniqueName: \"kubernetes.io/projected/cf9d5423-df11-41b2-986d-a1e19c0385f5-kube-api-access-q45x8\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.060648 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.060555 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-oauth-config\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.161747 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.161706 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q45x8\" (UniqueName: \"kubernetes.io/projected/cf9d5423-df11-41b2-986d-a1e19c0385f5-kube-api-access-q45x8\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.161999 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.161764 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-oauth-config\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.161999 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.161795 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-service-ca\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.161999 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.161826 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-oauth-serving-cert\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.161999 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.161874 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-serving-cert\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.162299 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.161898 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-trusted-ca-bundle\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.162431 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.162344 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-config\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.163247 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.163220 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-oauth-serving-cert\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.163354 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.163113 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-config\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.164204 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.164173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-service-ca\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.168288 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.166143 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-oauth-config\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.169096 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.169071 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-trusted-ca-bundle\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.169452 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.169424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-serving-cert\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.172084 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.172064 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q45x8\" (UniqueName: \"kubernetes.io/projected/cf9d5423-df11-41b2-986d-a1e19c0385f5-kube-api-access-q45x8\") pod \"console-db8b4c96b-4k9kc\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:02.251294 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:02.251148 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:03.060092 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:03.060051 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:59:03.060552 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:03.060145 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:59:03.065471 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:03.065445 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:59:03.697646 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:03.697615 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:59:05.563925 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:05.563901 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db8b4c96b-4k9kc"] Jun 02 01:59:05.566330 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:59:05.566289 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9d5423_df11_41b2_986d_a1e19c0385f5.slice/crio-b33613d11927b1bec6f796e8cbdd3858ea7d8f4668343108fd523ae781d3e49d WatchSource:0}: Error finding container b33613d11927b1bec6f796e8cbdd3858ea7d8f4668343108fd523ae781d3e49d: Status 404 returned error can't find the container with id b33613d11927b1bec6f796e8cbdd3858ea7d8f4668343108fd523ae781d3e49d Jun 02 01:59:05.700972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:05.700893 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8b4c96b-4k9kc" event={"ID":"cf9d5423-df11-41b2-986d-a1e19c0385f5","Type":"ContainerStarted","Data":"a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40"} Jun 02 01:59:05.700972 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:05.700930 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8b4c96b-4k9kc" event={"ID":"cf9d5423-df11-41b2-986d-a1e19c0385f5","Type":"ContainerStarted","Data":"b33613d11927b1bec6f796e8cbdd3858ea7d8f4668343108fd523ae781d3e49d"} Jun 02 01:59:05.702428 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:05.702399 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-p86kn" event={"ID":"d027c761-42a9-46f8-84f1-9bf70b5c508f","Type":"ContainerStarted","Data":"2b03f7a87c40185e99c92aa1e0c8834cfe2315fd5e521afdd011471fb5133326"} Jun 02 01:59:05.723467 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:05.723414 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-db8b4c96b-4k9kc" podStartSLOduration=4.723399275 podStartE2EDuration="4.723399275s" podCreationTimestamp="2026-06-02 01:59:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:59:05.722446606 +0000 UTC m=+155.221990273" watchObservedRunningTime="2026-06-02 01:59:05.723399275 +0000 UTC m=+155.222942943" Jun 02 01:59:05.742410 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:05.742065 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-p86kn" podStartSLOduration=1.058146689 podStartE2EDuration="16.742047295s" podCreationTimestamp="2026-06-02 01:58:49 +0000 UTC" firstStartedPulling="2026-06-02 01:58:49.860946058 +0000 UTC m=+139.360489716" lastFinishedPulling="2026-06-02 01:59:05.544846662 +0000 UTC m=+155.044390322" observedRunningTime="2026-06-02 01:59:05.740375993 +0000 UTC m=+155.239919660" watchObservedRunningTime="2026-06-02 01:59:05.742047295 +0000 UTC m=+155.241590963" Jun 02 01:59:06.706017 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:06.705959 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:59:06.727293 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:06.727260 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-p86kn" Jun 02 01:59:12.252155 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:12.252113 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:12.252707 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:12.252166 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:12.257764 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:12.257732 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:12.730548 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:12.730511 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 01:59:12.802857 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:12.802822 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777966c6b7-wx4tx"] Jun 02 01:59:19.746815 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:19.746779 2579 generic.go:358] "Generic (PLEG): container finished" podID="7e198b4a-906c-4558-bbf6-e00831ad8d00" containerID="1d9060f3744afa65c887950295b202e1bbabb80d99f3e39e55071096857db964" exitCode=0 Jun 02 01:59:19.747272 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:19.746854 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" event={"ID":"7e198b4a-906c-4558-bbf6-e00831ad8d00","Type":"ContainerDied","Data":"1d9060f3744afa65c887950295b202e1bbabb80d99f3e39e55071096857db964"} Jun 02 01:59:19.747272 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:19.747183 2579 scope.go:117] "RemoveContainer" containerID="1d9060f3744afa65c887950295b202e1bbabb80d99f3e39e55071096857db964" Jun 02 01:59:20.755678 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:20.754878 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-dkxp2" event={"ID":"7e198b4a-906c-4558-bbf6-e00831ad8d00","Type":"ContainerStarted","Data":"7a08eacd784a31bfcef596292ebde6bb2a49198b06e52782b2e1dd5880683123"} Jun 02 01:59:30.784522 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:30.784487 2579 generic.go:358] "Generic (PLEG): container finished" podID="3d630ea1-2147-4486-8a39-8eaa45ffe09c" containerID="90085a539197ac31f396a5ba6e6c659b309f964285a0a533817edecf41a18cfd" exitCode=0 Jun 02 01:59:30.784948 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:30.784560 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" event={"ID":"3d630ea1-2147-4486-8a39-8eaa45ffe09c","Type":"ContainerDied","Data":"90085a539197ac31f396a5ba6e6c659b309f964285a0a533817edecf41a18cfd"} Jun 02 01:59:30.784948 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:30.784882 2579 scope.go:117] "RemoveContainer" containerID="90085a539197ac31f396a5ba6e6c659b309f964285a0a533817edecf41a18cfd" Jun 02 01:59:31.791780 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:31.791737 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-sx5lb" event={"ID":"3d630ea1-2147-4486-8a39-8eaa45ffe09c","Type":"ContainerStarted","Data":"07d13031feead101764b9fba67e4d94dae2a18c0ce35b90a8cd9b107d3a77679"} Jun 02 01:59:37.828858 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:37.828814 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-777966c6b7-wx4tx" podUID="a668840a-77a0-4079-857a-fe10a87afc25" containerName="console" containerID="cri-o://3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17" gracePeriod=15 Jun 02 01:59:38.088393 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.088337 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-777966c6b7-wx4tx_a668840a-77a0-4079-857a-fe10a87afc25/console/0.log" Jun 02 01:59:38.088495 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.088409 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:59:38.177893 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.177861 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-console-config\") pod \"a668840a-77a0-4079-857a-fe10a87afc25\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " Jun 02 01:59:38.177893 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.177903 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfqxc\" (UniqueName: \"kubernetes.io/projected/a668840a-77a0-4079-857a-fe10a87afc25-kube-api-access-tfqxc\") pod \"a668840a-77a0-4079-857a-fe10a87afc25\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " Jun 02 01:59:38.178138 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.177921 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-oauth-serving-cert\") pod \"a668840a-77a0-4079-857a-fe10a87afc25\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " Jun 02 01:59:38.178138 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.177959 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-oauth-config\") pod \"a668840a-77a0-4079-857a-fe10a87afc25\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " Jun 02 01:59:38.178138 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.178009 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-service-ca\") pod \"a668840a-77a0-4079-857a-fe10a87afc25\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " Jun 02 01:59:38.178138 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.178039 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-serving-cert\") pod \"a668840a-77a0-4079-857a-fe10a87afc25\" (UID: \"a668840a-77a0-4079-857a-fe10a87afc25\") " Jun 02 01:59:38.178415 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.178376 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-console-config" (OuterVolumeSpecName: "console-config") pod "a668840a-77a0-4079-857a-fe10a87afc25" (UID: "a668840a-77a0-4079-857a-fe10a87afc25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:38.178549 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.178424 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-service-ca" (OuterVolumeSpecName: "service-ca") pod "a668840a-77a0-4079-857a-fe10a87afc25" (UID: "a668840a-77a0-4079-857a-fe10a87afc25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:38.178549 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.178385 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a668840a-77a0-4079-857a-fe10a87afc25" (UID: "a668840a-77a0-4079-857a-fe10a87afc25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:38.180456 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.180435 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a668840a-77a0-4079-857a-fe10a87afc25" (UID: "a668840a-77a0-4079-857a-fe10a87afc25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:38.180539 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.180452 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a668840a-77a0-4079-857a-fe10a87afc25" (UID: "a668840a-77a0-4079-857a-fe10a87afc25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:38.180539 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.180494 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a668840a-77a0-4079-857a-fe10a87afc25-kube-api-access-tfqxc" (OuterVolumeSpecName: "kube-api-access-tfqxc") pod "a668840a-77a0-4079-857a-fe10a87afc25" (UID: "a668840a-77a0-4079-857a-fe10a87afc25"). InnerVolumeSpecName "kube-api-access-tfqxc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:38.279193 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.279160 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:38.279193 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.279187 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfqxc\" (UniqueName: \"kubernetes.io/projected/a668840a-77a0-4079-857a-fe10a87afc25-kube-api-access-tfqxc\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:38.279193 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.279197 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:38.279407 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.279206 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:38.279407 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.279215 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a668840a-77a0-4079-857a-fe10a87afc25-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:38.279407 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.279223 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a668840a-77a0-4079-857a-fe10a87afc25-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:38.814018 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.813989 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-777966c6b7-wx4tx_a668840a-77a0-4079-857a-fe10a87afc25/console/0.log" Jun 02 01:59:38.814183 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.814029 2579 generic.go:358] "Generic (PLEG): container finished" podID="a668840a-77a0-4079-857a-fe10a87afc25" containerID="3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17" exitCode=2 Jun 02 01:59:38.814183 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.814115 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-777966c6b7-wx4tx" Jun 02 01:59:38.814183 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.814123 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777966c6b7-wx4tx" event={"ID":"a668840a-77a0-4079-857a-fe10a87afc25","Type":"ContainerDied","Data":"3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17"} Jun 02 01:59:38.814183 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.814159 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-777966c6b7-wx4tx" event={"ID":"a668840a-77a0-4079-857a-fe10a87afc25","Type":"ContainerDied","Data":"4f50615ab582ae22bfc853581ba1ea96ff477df783fdb2d929043c580abaf8a0"} Jun 02 01:59:38.814183 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.814173 2579 scope.go:117] "RemoveContainer" containerID="3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17" Jun 02 01:59:38.822706 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.822691 2579 scope.go:117] "RemoveContainer" containerID="3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17" Jun 02 01:59:38.822967 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:38.822941 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17\": container with ID starting with 3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17 not found: ID does not exist" containerID="3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17" Jun 02 01:59:38.823034 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.822980 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17"} err="failed to get container status \"3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17\": rpc error: code = NotFound desc = could not find container \"3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17\": container with ID starting with 3a1ef20d34a4ba1d9b33696195e8d1df9ffa170b7c7516484cfd97a41cf3be17 not found: ID does not exist" Jun 02 01:59:38.835609 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.835586 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-777966c6b7-wx4tx"] Jun 02 01:59:38.845365 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:38.845340 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-777966c6b7-wx4tx"] Jun 02 01:59:39.106604 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:39.106574 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a668840a-77a0-4079-857a-fe10a87afc25" path="/var/lib/kubelet/pods/a668840a-77a0-4079-857a-fe10a87afc25/volumes" Jun 02 01:59:54.037289 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.037249 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:59:54.037937 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.037901 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="alertmanager" containerID="cri-o://51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910" gracePeriod=120 Jun 02 01:59:54.038074 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.038053 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy" containerID="cri-o://347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e" gracePeriod=120 Jun 02 01:59:54.038144 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.038124 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-web" containerID="cri-o://8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d" gracePeriod=120 Jun 02 01:59:54.038201 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.038182 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="config-reloader" containerID="cri-o://547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d" gracePeriod=120 Jun 02 01:59:54.038296 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.038048 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-metric" containerID="cri-o://2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b" gracePeriod=120 Jun 02 01:59:54.038657 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.038632 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="prom-label-proxy" containerID="cri-o://56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e" gracePeriod=120 Jun 02 01:59:54.866758 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866728 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e" exitCode=0 Jun 02 01:59:54.866758 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866753 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e" exitCode=0 Jun 02 01:59:54.866758 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866759 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d" exitCode=0 Jun 02 01:59:54.866758 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866765 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910" exitCode=0 Jun 02 01:59:54.867031 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866803 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e"} Jun 02 01:59:54.867031 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866836 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e"} Jun 02 01:59:54.867031 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866846 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d"} Jun 02 01:59:54.867031 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:54.866855 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910"} Jun 02 01:59:55.280992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.280971 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:55.419784 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.419705 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-main-tls\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.419784 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.419760 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lwxr\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-kube-api-access-5lwxr\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.419784 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.419779 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-metrics-client-ca\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420047 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.419900 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-main-db\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420047 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.419950 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-out\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420047 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.419995 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420047 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420024 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420053 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-tls-assets\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420096 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-web\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420119 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-volume\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420163 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-cluster-tls-config\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420202 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-web-config\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420226 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-trusted-ca-bundle\") pod \"5ccc143c-ca5f-41a8-b046-de19c39e0559\" (UID: \"5ccc143c-ca5f-41a8-b046-de19c39e0559\") " Jun 02 01:59:55.420251 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420223 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:55.420770 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420246 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:55.420770 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420627 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-metrics-client-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.420770 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.420646 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-main-db\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.421168 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.421019 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:55.423216 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.423153 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-out" (OuterVolumeSpecName: "config-out") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:55.423216 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.423167 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.423403 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.423373 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-kube-api-access-5lwxr" (OuterVolumeSpecName: "kube-api-access-5lwxr") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "kube-api-access-5lwxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:55.423529 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.423439 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.424034 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.424007 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.424130 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.424009 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:55.424645 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.424620 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.424781 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.424721 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-volume" (OuterVolumeSpecName: "config-volume") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.428083 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.428014 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.434120 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.434101 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-web-config" (OuterVolumeSpecName: "web-config") pod "5ccc143c-ca5f-41a8-b046-de19c39e0559" (UID: "5ccc143c-ca5f-41a8-b046-de19c39e0559"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:55.521644 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521611 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521644 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521639 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-volume\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521644 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521649 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-cluster-tls-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521676 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-web-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521687 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ccc143c-ca5f-41a8-b046-de19c39e0559-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521696 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-main-tls\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521706 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lwxr\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-kube-api-access-5lwxr\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521718 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5ccc143c-ca5f-41a8-b046-de19c39e0559-config-out\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521727 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521737 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5ccc143c-ca5f-41a8-b046-de19c39e0559-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.521874 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.521746 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5ccc143c-ca5f-41a8-b046-de19c39e0559-tls-assets\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 01:59:55.871892 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.871859 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b" exitCode=0 Jun 02 01:59:55.871892 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.871889 2579 generic.go:358] "Generic (PLEG): container finished" podID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerID="8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d" exitCode=0 Jun 02 01:59:55.872078 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.871942 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b"} Jun 02 01:59:55.872078 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.871976 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:55.872078 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.871982 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d"} Jun 02 01:59:55.872078 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.871994 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5ccc143c-ca5f-41a8-b046-de19c39e0559","Type":"ContainerDied","Data":"f57f6fdbbc4b698bccf94a89cc5b0d7847a0af553ed4f8cce7850ab19bd4de90"} Jun 02 01:59:55.872078 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.872011 2579 scope.go:117] "RemoveContainer" containerID="56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e" Jun 02 01:59:55.879613 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.879478 2579 scope.go:117] "RemoveContainer" containerID="2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b" Jun 02 01:59:55.886731 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.886714 2579 scope.go:117] "RemoveContainer" containerID="347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e" Jun 02 01:59:55.893009 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.892993 2579 scope.go:117] "RemoveContainer" containerID="8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d" Jun 02 01:59:55.897327 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.897307 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:59:55.900992 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.900975 2579 scope.go:117] "RemoveContainer" containerID="547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d" Jun 02 01:59:55.901264 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.901244 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:59:55.907435 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.907421 2579 scope.go:117] "RemoveContainer" containerID="51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910" Jun 02 01:59:55.913905 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.913886 2579 scope.go:117] "RemoveContainer" containerID="4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61" Jun 02 01:59:55.920122 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920102 2579 scope.go:117] "RemoveContainer" containerID="56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e" Jun 02 01:59:55.920386 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.920366 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e\": container with ID starting with 56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e not found: ID does not exist" containerID="56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e" Jun 02 01:59:55.920435 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920398 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e"} err="failed to get container status \"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e\": rpc error: code = NotFound desc = could not find container \"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e\": container with ID starting with 56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e not found: ID does not exist" Jun 02 01:59:55.920435 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920417 2579 scope.go:117] "RemoveContainer" containerID="2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b" Jun 02 01:59:55.920638 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.920619 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b\": container with ID starting with 2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b not found: ID does not exist" containerID="2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b" Jun 02 01:59:55.920752 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920646 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b"} err="failed to get container status \"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b\": rpc error: code = NotFound desc = could not find container \"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b\": container with ID starting with 2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b not found: ID does not exist" Jun 02 01:59:55.920839 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920755 2579 scope.go:117] "RemoveContainer" containerID="347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e" Jun 02 01:59:55.920972 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.920956 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e\": container with ID starting with 347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e not found: ID does not exist" containerID="347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e" Jun 02 01:59:55.921023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920976 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e"} err="failed to get container status \"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e\": rpc error: code = NotFound desc = could not find container \"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e\": container with ID starting with 347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e not found: ID does not exist" Jun 02 01:59:55.921023 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.920989 2579 scope.go:117] "RemoveContainer" containerID="8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d" Jun 02 01:59:55.921174 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.921156 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d\": container with ID starting with 8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d not found: ID does not exist" containerID="8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d" Jun 02 01:59:55.921210 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921176 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d"} err="failed to get container status \"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d\": rpc error: code = NotFound desc = could not find container \"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d\": container with ID starting with 8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d not found: ID does not exist" Jun 02 01:59:55.921210 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921188 2579 scope.go:117] "RemoveContainer" containerID="547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d" Jun 02 01:59:55.921359 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.921343 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d\": container with ID starting with 547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d not found: ID does not exist" containerID="547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d" Jun 02 01:59:55.921403 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921363 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d"} err="failed to get container status \"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d\": rpc error: code = NotFound desc = could not find container \"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d\": container with ID starting with 547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d not found: ID does not exist" Jun 02 01:59:55.921403 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921374 2579 scope.go:117] "RemoveContainer" containerID="51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910" Jun 02 01:59:55.921559 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.921542 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910\": container with ID starting with 51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910 not found: ID does not exist" containerID="51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910" Jun 02 01:59:55.921621 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921562 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910"} err="failed to get container status \"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910\": rpc error: code = NotFound desc = could not find container \"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910\": container with ID starting with 51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910 not found: ID does not exist" Jun 02 01:59:55.921621 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921573 2579 scope.go:117] "RemoveContainer" containerID="4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61" Jun 02 01:59:55.921780 ip-10-0-131-106 kubenswrapper[2579]: E0602 01:59:55.921767 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61\": container with ID starting with 4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61 not found: ID does not exist" containerID="4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61" Jun 02 01:59:55.921815 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921782 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61"} err="failed to get container status \"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61\": rpc error: code = NotFound desc = could not find container \"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61\": container with ID starting with 4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61 not found: ID does not exist" Jun 02 01:59:55.921815 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921793 2579 scope.go:117] "RemoveContainer" containerID="56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e" Jun 02 01:59:55.921973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921959 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e"} err="failed to get container status \"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e\": rpc error: code = NotFound desc = could not find container \"56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e\": container with ID starting with 56c12c9e6234d2ec5b15d1676aed9fa52481e17f64c6297d811516f0987fa63e not found: ID does not exist" Jun 02 01:59:55.921973 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.921972 2579 scope.go:117] "RemoveContainer" containerID="2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b" Jun 02 01:59:55.922187 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922168 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b"} err="failed to get container status \"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b\": rpc error: code = NotFound desc = could not find container \"2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b\": container with ID starting with 2b49f58cd716be488e3b56b5eeaae40a11ce4ac48ea8aedf6e8b3c7355b22c6b not found: ID does not exist" Jun 02 01:59:55.922230 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922189 2579 scope.go:117] "RemoveContainer" containerID="347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e" Jun 02 01:59:55.922367 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922348 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e"} err="failed to get container status \"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e\": rpc error: code = NotFound desc = could not find container \"347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e\": container with ID starting with 347f65f627699a8670fe9f10be27b4973459440be3f11039837a3775a6a2133e not found: ID does not exist" Jun 02 01:59:55.922406 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922370 2579 scope.go:117] "RemoveContainer" containerID="8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d" Jun 02 01:59:55.922550 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922533 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d"} err="failed to get container status \"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d\": rpc error: code = NotFound desc = could not find container \"8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d\": container with ID starting with 8a7952886d5fd3756927465c47b3c5e24f8817dbfce5c8fc22dce4bdaa1e568d not found: ID does not exist" Jun 02 01:59:55.922550 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922548 2579 scope.go:117] "RemoveContainer" containerID="547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d" Jun 02 01:59:55.922767 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922744 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d"} err="failed to get container status \"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d\": rpc error: code = NotFound desc = could not find container \"547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d\": container with ID starting with 547a35b77f3fa701b8923cdaaa6c020336c474b2b10554518a9d7db522c1376d not found: ID does not exist" Jun 02 01:59:55.922767 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922767 2579 scope.go:117] "RemoveContainer" containerID="51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910" Jun 02 01:59:55.923015 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.922996 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910"} err="failed to get container status \"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910\": rpc error: code = NotFound desc = could not find container \"51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910\": container with ID starting with 51cdc167b6138ea431e69aa551a02d037266f78818af6956ab71f50718c69910 not found: ID does not exist" Jun 02 01:59:55.923068 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.923017 2579 scope.go:117] "RemoveContainer" containerID="4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61" Jun 02 01:59:55.923261 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.923243 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61"} err="failed to get container status \"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61\": rpc error: code = NotFound desc = could not find container \"4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61\": container with ID starting with 4b198e957a89088b20e229630d8ae78d6a37408a45dfbd5e5dc6f2b9621e4c61 not found: ID does not exist" Jun 02 01:59:55.927211 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927192 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:59:55.927469 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927456 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="config-reloader" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927471 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="config-reloader" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927479 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="prom-label-proxy" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927485 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="prom-label-proxy" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927497 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a668840a-77a0-4079-857a-fe10a87afc25" containerName="console" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927503 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a668840a-77a0-4079-857a-fe10a87afc25" containerName="console" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927510 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-web" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927515 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-web" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927522 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="init-config-reloader" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927526 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="init-config-reloader" Jun 02 01:59:55.927526 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927532 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="alertmanager" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927537 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="alertmanager" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927548 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927553 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927558 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-metric" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927564 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-metric" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927606 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="alertmanager" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927613 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="a668840a-77a0-4079-857a-fe10a87afc25" containerName="console" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927620 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="config-reloader" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927625 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="prom-label-proxy" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927630 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927638 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-web" Jun 02 01:59:55.927852 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.927644 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" containerName="kube-rbac-proxy-metric" Jun 02 01:59:55.930864 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.930849 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:55.933626 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933608 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-m7zzm\"" Jun 02 01:59:55.933741 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933627 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 01:59:55.933741 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933710 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 01:59:55.933741 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933718 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 01:59:55.933926 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933758 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 01:59:55.933926 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933914 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 01:59:55.934007 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.933974 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 01:59:55.934603 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.934588 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 01:59:55.934813 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.934796 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 01:59:55.940977 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.940960 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 01:59:55.944224 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:55.944203 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:59:56.026129 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-config-out\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026269 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026135 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026269 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026269 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026427 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026367 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5l6\" (UniqueName: \"kubernetes.io/projected/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-kube-api-access-gm5l6\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026628 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026831 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026796 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.026911 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.026879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.027036 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.027019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.027194 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.027152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.027321 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.027288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.027408 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.027378 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-web-config\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.027491 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.027457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.128953 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.128881 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-config-out\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.128953 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.128915 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.128953 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.128935 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129058 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129096 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5l6\" (UniqueName: \"kubernetes.io/projected/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-kube-api-access-gm5l6\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129152 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129138 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129192 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129220 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129258 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129304 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129335 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129368 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-web-config\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.129639 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129394 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.130061 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.129913 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.130061 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.130007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.130305 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.130256 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.132449 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.132417 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.132538 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.132507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.132623 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.132601 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-config-out\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.132709 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.132636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.132851 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.132829 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-config-volume\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.132919 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.132893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.133058 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.133035 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.133100 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.133043 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.134557 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.134540 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-web-config\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.137500 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.137479 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5l6\" (UniqueName: \"kubernetes.io/projected/6c1c93b2-0c7c-4c06-b36f-f818eb81e212-kube-api-access-gm5l6\") pod \"alertmanager-main-0\" (UID: \"6c1c93b2-0c7c-4c06-b36f-f818eb81e212\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.240588 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.240546 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:59:56.379225 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.379172 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:59:56.381499 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:59:56.381468 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1c93b2_0c7c_4c06_b36f_f818eb81e212.slice/crio-4df9cda12b95c0dff427d0fc290d66b677cff7acb1426d65980974c0a14a4d00 WatchSource:0}: Error finding container 4df9cda12b95c0dff427d0fc290d66b677cff7acb1426d65980974c0a14a4d00: Status 404 returned error can't find the container with id 4df9cda12b95c0dff427d0fc290d66b677cff7acb1426d65980974c0a14a4d00 Jun 02 01:59:56.877196 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.877161 2579 generic.go:358] "Generic (PLEG): container finished" podID="6c1c93b2-0c7c-4c06-b36f-f818eb81e212" containerID="831e56b103257dffac126b7dad52d96317519912244186488b4d34efa0c171f5" exitCode=0 Jun 02 01:59:56.877377 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.877256 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerDied","Data":"831e56b103257dffac126b7dad52d96317519912244186488b4d34efa0c171f5"} Jun 02 01:59:56.877377 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:56.877294 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"4df9cda12b95c0dff427d0fc290d66b677cff7acb1426d65980974c0a14a4d00"} Jun 02 01:59:57.108500 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.108467 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ccc143c-ca5f-41a8-b046-de19c39e0559" path="/var/lib/kubelet/pods/5ccc143c-ca5f-41a8-b046-de19c39e0559/volumes" Jun 02 01:59:57.883714 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.883679 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"9a40f6cae4f09d88ef5def54a34c5ea0aceb092ff41fb9b73f4813b52c38876d"} Jun 02 01:59:57.883714 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.883712 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"099cad77be4656e6c1f0bc215448c44d0612ea12fb5b111f219d6e8ce515cfc4"} Jun 02 01:59:57.883714 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.883724 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"a1ddf35722d24775b924324d762b4e204d71e46a7a596f1e93bbe648f997bf25"} Jun 02 01:59:57.884136 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.883732 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"1467aa37e13c346c3511581ee9f61fd651e69d3aabe8958c6bc38f0e0413bd86"} Jun 02 01:59:57.884136 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.883740 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"1cdcca09b0fa0a60146d60ecdc362bb5211800653e36722b929417fb2c8d828a"} Jun 02 01:59:57.884136 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.883748 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6c1c93b2-0c7c-4c06-b36f-f818eb81e212","Type":"ContainerStarted","Data":"304515d69b875418375bfc8d8d37ecb9f3406d1d57f609d2d57438d9ab928a17"} Jun 02 01:59:57.909902 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:57.909856 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9098415859999998 podStartE2EDuration="2.909841586s" podCreationTimestamp="2026-06-02 01:59:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:59:57.909610444 +0000 UTC m=+207.409154122" watchObservedRunningTime="2026-06-02 01:59:57.909841586 +0000 UTC m=+207.409385253" Jun 02 01:59:58.071864 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.071826 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-db7c9c56f-2tqrm"] Jun 02 01:59:58.074323 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.074302 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.077139 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.077104 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 01:59:58.077139 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.077118 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 01:59:58.077301 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.077114 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 01:59:58.077301 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.077258 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 01:59:58.077493 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.077476 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 01:59:58.077572 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.077490 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kvb9f\"" Jun 02 01:59:58.086726 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.085796 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 01:59:58.088951 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.088382 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db7c9c56f-2tqrm"] Jun 02 01:59:58.246401 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-telemeter-client-tls\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246401 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-serving-certs-ca-bundle\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246401 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246686 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246432 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tstnl\" (UniqueName: \"kubernetes.io/projected/7abc06ba-3e44-4e48-85ce-c2b24916075d-kube-api-access-tstnl\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246686 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-federate-client-tls\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246686 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246686 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-secret-telemeter-client\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.246686 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.246577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-metrics-client-ca\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347382 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347343 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-telemeter-client-tls\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347382 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347385 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-serving-certs-ca-bundle\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347409 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347456 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tstnl\" (UniqueName: \"kubernetes.io/projected/7abc06ba-3e44-4e48-85ce-c2b24916075d-kube-api-access-tstnl\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347494 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-federate-client-tls\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347522 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347586 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347568 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-secret-telemeter-client\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.347876 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.347608 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-metrics-client-ca\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.348197 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.348169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-serving-certs-ca-bundle\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.348302 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.348270 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-metrics-client-ca\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.348369 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.348323 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7abc06ba-3e44-4e48-85ce-c2b24916075d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.350321 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.350291 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-telemeter-client-tls\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.350321 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.350320 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-federate-client-tls\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.350654 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.350626 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.351698 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.351163 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7abc06ba-3e44-4e48-85ce-c2b24916075d-secret-telemeter-client\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.358607 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.358587 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tstnl\" (UniqueName: \"kubernetes.io/projected/7abc06ba-3e44-4e48-85ce-c2b24916075d-kube-api-access-tstnl\") pod \"telemeter-client-db7c9c56f-2tqrm\" (UID: \"7abc06ba-3e44-4e48-85ce-c2b24916075d\") " pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.391429 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.391399 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" Jun 02 01:59:58.540359 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.540331 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db7c9c56f-2tqrm"] Jun 02 01:59:58.544025 ip-10-0-131-106 kubenswrapper[2579]: W0602 01:59:58.543993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abc06ba_3e44_4e48_85ce_c2b24916075d.slice/crio-390e055cc71ea0d9c1012b18f482b2de317d729ddfd559ee0fb18fbf5ed6116a WatchSource:0}: Error finding container 390e055cc71ea0d9c1012b18f482b2de317d729ddfd559ee0fb18fbf5ed6116a: Status 404 returned error can't find the container with id 390e055cc71ea0d9c1012b18f482b2de317d729ddfd559ee0fb18fbf5ed6116a Jun 02 01:59:58.887205 ip-10-0-131-106 kubenswrapper[2579]: I0602 01:59:58.887164 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" event={"ID":"7abc06ba-3e44-4e48-85ce-c2b24916075d","Type":"ContainerStarted","Data":"390e055cc71ea0d9c1012b18f482b2de317d729ddfd559ee0fb18fbf5ed6116a"} Jun 02 02:00:00.896064 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:00.896034 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" event={"ID":"7abc06ba-3e44-4e48-85ce-c2b24916075d","Type":"ContainerStarted","Data":"1512fd8e716bcef5b1a57282dec4683124f937ae43accaef07dd7e290d86ad39"} Jun 02 02:00:00.896364 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:00.896076 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" event={"ID":"7abc06ba-3e44-4e48-85ce-c2b24916075d","Type":"ContainerStarted","Data":"c8be777085c21f496bfaf81a8f7f490af33aff535bdcc434eed36eb22d71294c"} Jun 02 02:00:01.901278 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:01.901240 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" event={"ID":"7abc06ba-3e44-4e48-85ce-c2b24916075d","Type":"ContainerStarted","Data":"66292bbd3ff32445924309bbea284eb76c08c745f56a817877d83f2523274fd9"} Jun 02 02:00:01.928918 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:01.928868 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-db7c9c56f-2tqrm" podStartSLOduration=1.757885598 podStartE2EDuration="3.928853631s" podCreationTimestamp="2026-06-02 01:59:58 +0000 UTC" firstStartedPulling="2026-06-02 01:59:58.545957802 +0000 UTC m=+208.045501446" lastFinishedPulling="2026-06-02 02:00:00.71692583 +0000 UTC m=+210.216469479" observedRunningTime="2026-06-02 02:00:01.926279125 +0000 UTC m=+211.425822792" watchObservedRunningTime="2026-06-02 02:00:01.928853631 +0000 UTC m=+211.428397298" Jun 02 02:00:02.597754 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.597719 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5966bd665f-7gps4"] Jun 02 02:00:02.599893 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.599875 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.613121 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.613095 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5966bd665f-7gps4"] Jun 02 02:00:02.684563 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-config\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.684766 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-serving-cert\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.684766 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684616 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxprx\" (UniqueName: \"kubernetes.io/projected/d9cb134b-99d8-44c4-87df-06ca5470abf0-kube-api-access-qxprx\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.684766 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684642 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-trusted-ca-bundle\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.684766 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-service-ca\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.684766 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684703 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-oauth-serving-cert\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.684766 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.684725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-oauth-config\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.785688 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785629 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-trusted-ca-bundle\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.785688 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785687 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-service-ca\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.785944 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785804 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-oauth-serving-cert\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.785944 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785850 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-oauth-config\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.785944 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785900 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-config\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.786106 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785963 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-serving-cert\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.786106 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.785997 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qxprx\" (UniqueName: \"kubernetes.io/projected/d9cb134b-99d8-44c4-87df-06ca5470abf0-kube-api-access-qxprx\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.786415 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.786384 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-service-ca\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.786533 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.786468 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-oauth-serving-cert\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.786597 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.786555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-config\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.786597 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.786580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-trusted-ca-bundle\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.788525 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.788502 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-serving-cert\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.788714 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.788692 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-oauth-config\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.794934 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.794882 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxprx\" (UniqueName: \"kubernetes.io/projected/d9cb134b-99d8-44c4-87df-06ca5470abf0-kube-api-access-qxprx\") pod \"console-5966bd665f-7gps4\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:02.909684 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:02.909595 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:03.056808 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:03.056782 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5966bd665f-7gps4"] Jun 02 02:00:03.059423 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:00:03.059393 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cb134b_99d8_44c4_87df_06ca5470abf0.slice/crio-ab49a2cdca1ab2d459622d2ce118514a8a681891d988ce138dfd7948f574e478 WatchSource:0}: Error finding container ab49a2cdca1ab2d459622d2ce118514a8a681891d988ce138dfd7948f574e478: Status 404 returned error can't find the container with id ab49a2cdca1ab2d459622d2ce118514a8a681891d988ce138dfd7948f574e478 Jun 02 02:00:03.908806 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:03.908772 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5966bd665f-7gps4" event={"ID":"d9cb134b-99d8-44c4-87df-06ca5470abf0","Type":"ContainerStarted","Data":"4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2"} Jun 02 02:00:03.908806 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:03.908808 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5966bd665f-7gps4" event={"ID":"d9cb134b-99d8-44c4-87df-06ca5470abf0","Type":"ContainerStarted","Data":"ab49a2cdca1ab2d459622d2ce118514a8a681891d988ce138dfd7948f574e478"} Jun 02 02:00:03.928915 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:03.928868 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5966bd665f-7gps4" podStartSLOduration=1.928855333 podStartE2EDuration="1.928855333s" podCreationTimestamp="2026-06-02 02:00:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:00:03.927049409 +0000 UTC m=+213.426593076" watchObservedRunningTime="2026-06-02 02:00:03.928855333 +0000 UTC m=+213.428399001" Jun 02 02:00:12.910340 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:12.910300 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:12.910340 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:12.910343 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:12.915301 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:12.915280 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:12.939119 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:12.939093 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:00:12.987804 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:12.987775 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db8b4c96b-4k9kc"] Jun 02 02:00:38.009255 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.009199 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-db8b4c96b-4k9kc" podUID="cf9d5423-df11-41b2-986d-a1e19c0385f5" containerName="console" containerID="cri-o://a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40" gracePeriod=15 Jun 02 02:00:38.250339 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.250319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-db8b4c96b-4k9kc_cf9d5423-df11-41b2-986d-a1e19c0385f5/console/0.log" Jun 02 02:00:38.250443 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.250394 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 02:00:38.354654 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354629 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-config\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.354811 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354687 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-service-ca\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.354811 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354713 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-trusted-ca-bundle\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.354811 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354748 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-oauth-serving-cert\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.354811 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354788 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q45x8\" (UniqueName: \"kubernetes.io/projected/cf9d5423-df11-41b2-986d-a1e19c0385f5-kube-api-access-q45x8\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.355025 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354820 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-serving-cert\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.355025 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.354880 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-oauth-config\") pod \"cf9d5423-df11-41b2-986d-a1e19c0385f5\" (UID: \"cf9d5423-df11-41b2-986d-a1e19c0385f5\") " Jun 02 02:00:38.355130 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.355090 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-config" (OuterVolumeSpecName: "console-config") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:00:38.355184 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.355159 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:38.355184 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.355168 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:00:38.355262 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.355181 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:00:38.355262 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.355193 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:00:38.356959 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.356933 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:00:38.357069 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.357007 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:00:38.357113 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.357064 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9d5423-df11-41b2-986d-a1e19c0385f5-kube-api-access-q45x8" (OuterVolumeSpecName: "kube-api-access-q45x8") pod "cf9d5423-df11-41b2-986d-a1e19c0385f5" (UID: "cf9d5423-df11-41b2-986d-a1e19c0385f5"). InnerVolumeSpecName "kube-api-access-q45x8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:00:38.455570 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.455542 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q45x8\" (UniqueName: \"kubernetes.io/projected/cf9d5423-df11-41b2-986d-a1e19c0385f5-kube-api-access-q45x8\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:38.455570 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.455564 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:38.455570 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.455574 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9d5423-df11-41b2-986d-a1e19c0385f5-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:38.455800 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.455583 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:38.455800 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.455592 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:38.455800 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:38.455603 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9d5423-df11-41b2-986d-a1e19c0385f5-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:00:39.010512 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.010484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-db8b4c96b-4k9kc_cf9d5423-df11-41b2-986d-a1e19c0385f5/console/0.log" Jun 02 02:00:39.011002 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.010525 2579 generic.go:358] "Generic (PLEG): container finished" podID="cf9d5423-df11-41b2-986d-a1e19c0385f5" containerID="a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40" exitCode=2 Jun 02 02:00:39.011002 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.010610 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db8b4c96b-4k9kc" Jun 02 02:00:39.011002 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.010607 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8b4c96b-4k9kc" event={"ID":"cf9d5423-df11-41b2-986d-a1e19c0385f5","Type":"ContainerDied","Data":"a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40"} Jun 02 02:00:39.011002 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.010698 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db8b4c96b-4k9kc" event={"ID":"cf9d5423-df11-41b2-986d-a1e19c0385f5","Type":"ContainerDied","Data":"b33613d11927b1bec6f796e8cbdd3858ea7d8f4668343108fd523ae781d3e49d"} Jun 02 02:00:39.011002 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.010714 2579 scope.go:117] "RemoveContainer" containerID="a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40" Jun 02 02:00:39.019466 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.019451 2579 scope.go:117] "RemoveContainer" containerID="a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40" Jun 02 02:00:39.019768 ip-10-0-131-106 kubenswrapper[2579]: E0602 02:00:39.019742 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40\": container with ID starting with a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40 not found: ID does not exist" containerID="a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40" Jun 02 02:00:39.019843 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.019779 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40"} err="failed to get container status \"a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40\": rpc error: code = NotFound desc = could not find container \"a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40\": container with ID starting with a19256342f3f1bacaaa3efefcd3c8318c2b758f37a97d58206ab9d73a10ffc40 not found: ID does not exist" Jun 02 02:00:39.032778 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.032754 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db8b4c96b-4k9kc"] Jun 02 02:00:39.036912 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.036888 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db8b4c96b-4k9kc"] Jun 02 02:00:39.106242 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:00:39.106217 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9d5423-df11-41b2-986d-a1e19c0385f5" path="/var/lib/kubelet/pods/cf9d5423-df11-41b2-986d-a1e19c0385f5/volumes" Jun 02 02:01:24.023503 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.023466 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5766474fcc-wd8th"] Jun 02 02:01:24.024039 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.023830 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9d5423-df11-41b2-986d-a1e19c0385f5" containerName="console" Jun 02 02:01:24.024039 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.023843 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9d5423-df11-41b2-986d-a1e19c0385f5" containerName="console" Jun 02 02:01:24.024039 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.023902 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf9d5423-df11-41b2-986d-a1e19c0385f5" containerName="console" Jun 02 02:01:24.027049 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.027031 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.035053 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.035030 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5766474fcc-wd8th"] Jun 02 02:01:24.113751 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-config\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.113921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-service-ca\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.113921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113821 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-oauth-serving-cert\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.113921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-oauth-config\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.113921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113860 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-trusted-ca-bundle\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.113921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113904 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-serving-cert\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.114083 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.113923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp46n\" (UniqueName: \"kubernetes.io/projected/234492df-8bee-4bdb-a0a5-dabc052ac50d-kube-api-access-xp46n\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.214919 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.214881 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-service-ca\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.214919 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.214927 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-oauth-serving-cert\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215174 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.214946 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-oauth-config\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215174 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.214965 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-trusted-ca-bundle\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215174 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.215000 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-serving-cert\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215174 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.215019 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp46n\" (UniqueName: \"kubernetes.io/projected/234492df-8bee-4bdb-a0a5-dabc052ac50d-kube-api-access-xp46n\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215174 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.215044 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-config\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215781 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.215752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-oauth-serving-cert\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215883 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.215790 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-config\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.215951 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.215931 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-trusted-ca-bundle\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.216172 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.216148 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-service-ca\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.217587 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.217567 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-oauth-config\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.217724 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.217705 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-serving-cert\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.224078 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.224053 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp46n\" (UniqueName: \"kubernetes.io/projected/234492df-8bee-4bdb-a0a5-dabc052ac50d-kube-api-access-xp46n\") pod \"console-5766474fcc-wd8th\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.337093 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.336985 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:24.472424 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:24.472348 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5766474fcc-wd8th"] Jun 02 02:01:24.474776 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:01:24.474749 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234492df_8bee_4bdb_a0a5_dabc052ac50d.slice/crio-f19164d861e50b5ade18f8efee5e01ab98bc7be01f1eec7500213d0d27e95187 WatchSource:0}: Error finding container f19164d861e50b5ade18f8efee5e01ab98bc7be01f1eec7500213d0d27e95187: Status 404 returned error can't find the container with id f19164d861e50b5ade18f8efee5e01ab98bc7be01f1eec7500213d0d27e95187 Jun 02 02:01:25.139780 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:25.139743 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5766474fcc-wd8th" event={"ID":"234492df-8bee-4bdb-a0a5-dabc052ac50d","Type":"ContainerStarted","Data":"457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd"} Jun 02 02:01:25.139780 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:25.139779 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5766474fcc-wd8th" event={"ID":"234492df-8bee-4bdb-a0a5-dabc052ac50d","Type":"ContainerStarted","Data":"f19164d861e50b5ade18f8efee5e01ab98bc7be01f1eec7500213d0d27e95187"} Jun 02 02:01:25.157423 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:25.157379 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5766474fcc-wd8th" podStartSLOduration=1.157365755 podStartE2EDuration="1.157365755s" podCreationTimestamp="2026-06-02 02:01:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:01:25.156851312 +0000 UTC m=+294.656394979" watchObservedRunningTime="2026-06-02 02:01:25.157365755 +0000 UTC m=+294.656909421" Jun 02 02:01:30.475014 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.474972 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q4dpz"] Jun 02 02:01:30.478377 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.478361 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.481028 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.481007 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 02:01:30.486410 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.486386 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q4dpz"] Jun 02 02:01:30.564805 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.564774 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/071ad239-b657-4ffb-8054-f9d8cecbac1c-dbus\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.564805 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.564809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/071ad239-b657-4ffb-8054-f9d8cecbac1c-kubelet-config\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.564962 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.564830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/071ad239-b657-4ffb-8054-f9d8cecbac1c-original-pull-secret\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.665643 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.665605 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/071ad239-b657-4ffb-8054-f9d8cecbac1c-dbus\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.665643 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.665647 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/071ad239-b657-4ffb-8054-f9d8cecbac1c-kubelet-config\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.665893 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.665701 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/071ad239-b657-4ffb-8054-f9d8cecbac1c-original-pull-secret\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.665893 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.665794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/071ad239-b657-4ffb-8054-f9d8cecbac1c-kubelet-config\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.665893 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.665802 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/071ad239-b657-4ffb-8054-f9d8cecbac1c-dbus\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.668277 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.668256 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/071ad239-b657-4ffb-8054-f9d8cecbac1c-original-pull-secret\") pod \"global-pull-secret-syncer-q4dpz\" (UID: \"071ad239-b657-4ffb-8054-f9d8cecbac1c\") " pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.788711 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.788638 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q4dpz" Jun 02 02:01:30.919374 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:30.919347 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q4dpz"] Jun 02 02:01:30.921649 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:01:30.921623 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071ad239_b657_4ffb_8054_f9d8cecbac1c.slice/crio-53b6150cedb8ec2d5f007fd9cad76c36ca7fb6a4dca094ecd4f7c08b80a2ed31 WatchSource:0}: Error finding container 53b6150cedb8ec2d5f007fd9cad76c36ca7fb6a4dca094ecd4f7c08b80a2ed31: Status 404 returned error can't find the container with id 53b6150cedb8ec2d5f007fd9cad76c36ca7fb6a4dca094ecd4f7c08b80a2ed31 Jun 02 02:01:31.040890 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:31.040867 2579 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 02:01:31.158085 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:31.158053 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q4dpz" event={"ID":"071ad239-b657-4ffb-8054-f9d8cecbac1c","Type":"ContainerStarted","Data":"53b6150cedb8ec2d5f007fd9cad76c36ca7fb6a4dca094ecd4f7c08b80a2ed31"} Jun 02 02:01:34.337453 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:34.337407 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:34.337925 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:34.337474 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:34.343055 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:34.343031 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:35.173001 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:35.172963 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q4dpz" event={"ID":"071ad239-b657-4ffb-8054-f9d8cecbac1c","Type":"ContainerStarted","Data":"b0ecadc4cff28ee571f38c80a5d6c12cfc54f73d22bbd24eb6e087268054f94b"} Jun 02 02:01:35.176736 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:35.176710 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:01:35.189231 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:35.189191 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q4dpz" podStartSLOduration=1.400459938 podStartE2EDuration="5.189177333s" podCreationTimestamp="2026-06-02 02:01:30 +0000 UTC" firstStartedPulling="2026-06-02 02:01:30.923180676 +0000 UTC m=+300.422724321" lastFinishedPulling="2026-06-02 02:01:34.711898069 +0000 UTC m=+304.211441716" observedRunningTime="2026-06-02 02:01:35.187818771 +0000 UTC m=+304.687362438" watchObservedRunningTime="2026-06-02 02:01:35.189177333 +0000 UTC m=+304.688721000" Jun 02 02:01:35.235952 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:01:35.235915 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5966bd665f-7gps4"] Jun 02 02:02:00.258733 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.258642 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5966bd665f-7gps4" podUID="d9cb134b-99d8-44c4-87df-06ca5470abf0" containerName="console" containerID="cri-o://4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2" gracePeriod=15 Jun 02 02:02:00.507408 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.507386 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5966bd665f-7gps4_d9cb134b-99d8-44c4-87df-06ca5470abf0/console/0.log" Jun 02 02:02:00.507535 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.507453 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:02:00.627478 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627424 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-service-ca\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.627478 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627492 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-serving-cert\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.627781 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627516 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxprx\" (UniqueName: \"kubernetes.io/projected/d9cb134b-99d8-44c4-87df-06ca5470abf0-kube-api-access-qxprx\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.627781 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627551 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-oauth-serving-cert\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.627781 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627605 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-oauth-config\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.627781 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627631 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-config\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.627781 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.627684 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-trusted-ca-bundle\") pod \"d9cb134b-99d8-44c4-87df-06ca5470abf0\" (UID: \"d9cb134b-99d8-44c4-87df-06ca5470abf0\") " Jun 02 02:02:00.628042 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.628012 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-service-ca" (OuterVolumeSpecName: "service-ca") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:02:00.628163 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.628132 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:02:00.628226 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.628177 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-config" (OuterVolumeSpecName: "console-config") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:02:00.628269 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.628247 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:02:00.629989 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.629965 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:02:00.630453 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.630433 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:02:00.630500 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.630466 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cb134b-99d8-44c4-87df-06ca5470abf0-kube-api-access-qxprx" (OuterVolumeSpecName: "kube-api-access-qxprx") pod "d9cb134b-99d8-44c4-87df-06ca5470abf0" (UID: "d9cb134b-99d8-44c4-87df-06ca5470abf0"). InnerVolumeSpecName "kube-api-access-qxprx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:02:00.728701 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728634 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.728701 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728697 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.728701 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728711 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.728921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728724 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxprx\" (UniqueName: \"kubernetes.io/projected/d9cb134b-99d8-44c4-87df-06ca5470abf0-kube-api-access-qxprx\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.728921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728737 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.728921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728748 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:00.728921 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:00.728761 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9cb134b-99d8-44c4-87df-06ca5470abf0-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:02:01.252706 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.252657 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5966bd665f-7gps4_d9cb134b-99d8-44c4-87df-06ca5470abf0/console/0.log" Jun 02 02:02:01.252865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.252719 2579 generic.go:358] "Generic (PLEG): container finished" podID="d9cb134b-99d8-44c4-87df-06ca5470abf0" containerID="4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2" exitCode=2 Jun 02 02:02:01.252865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.252787 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5966bd665f-7gps4" Jun 02 02:02:01.252865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.252810 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5966bd665f-7gps4" event={"ID":"d9cb134b-99d8-44c4-87df-06ca5470abf0","Type":"ContainerDied","Data":"4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2"} Jun 02 02:02:01.252865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.252848 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5966bd665f-7gps4" event={"ID":"d9cb134b-99d8-44c4-87df-06ca5470abf0","Type":"ContainerDied","Data":"ab49a2cdca1ab2d459622d2ce118514a8a681891d988ce138dfd7948f574e478"} Jun 02 02:02:01.252865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.252863 2579 scope.go:117] "RemoveContainer" containerID="4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2" Jun 02 02:02:01.261227 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.261035 2579 scope.go:117] "RemoveContainer" containerID="4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2" Jun 02 02:02:01.261448 ip-10-0-131-106 kubenswrapper[2579]: E0602 02:02:01.261302 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2\": container with ID starting with 4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2 not found: ID does not exist" containerID="4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2" Jun 02 02:02:01.261448 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.261328 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2"} err="failed to get container status \"4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2\": rpc error: code = NotFound desc = could not find container \"4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2\": container with ID starting with 4bdddf1e5975f4f4952fc3c7eda41151b2ec68d71171962c178e73abb01c8ef2 not found: ID does not exist" Jun 02 02:02:01.272928 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.272904 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5966bd665f-7gps4"] Jun 02 02:02:01.276247 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:01.276226 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5966bd665f-7gps4"] Jun 02 02:02:03.108498 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:03.108453 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9cb134b-99d8-44c4-87df-06ca5470abf0" path="/var/lib/kubelet/pods/d9cb134b-99d8-44c4-87df-06ca5470abf0/volumes" Jun 02 02:02:07.360107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.360076 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58"] Jun 02 02:02:07.360470 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.360385 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cb134b-99d8-44c4-87df-06ca5470abf0" containerName="console" Jun 02 02:02:07.360470 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.360396 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cb134b-99d8-44c4-87df-06ca5470abf0" containerName="console" Jun 02 02:02:07.360470 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.360458 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9cb134b-99d8-44c4-87df-06ca5470abf0" containerName="console" Jun 02 02:02:07.365037 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.365017 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.368037 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.368017 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-h6kfx\"" Jun 02 02:02:07.368542 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.368529 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 02:02:07.368598 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.368564 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:02:07.376350 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.376328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da0fc323-6348-4b43-8162-b4031f2a5b2e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-c2h58\" (UID: \"da0fc323-6348-4b43-8162-b4031f2a5b2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.378412 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.378385 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58"] Jun 02 02:02:07.378627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.376885 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcld\" (UniqueName: \"kubernetes.io/projected/da0fc323-6348-4b43-8162-b4031f2a5b2e-kube-api-access-cwcld\") pod \"cert-manager-operator-controller-manager-54b9655956-c2h58\" (UID: \"da0fc323-6348-4b43-8162-b4031f2a5b2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.479305 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.479268 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da0fc323-6348-4b43-8162-b4031f2a5b2e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-c2h58\" (UID: \"da0fc323-6348-4b43-8162-b4031f2a5b2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.479460 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.479318 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcld\" (UniqueName: \"kubernetes.io/projected/da0fc323-6348-4b43-8162-b4031f2a5b2e-kube-api-access-cwcld\") pod \"cert-manager-operator-controller-manager-54b9655956-c2h58\" (UID: \"da0fc323-6348-4b43-8162-b4031f2a5b2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.479636 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.479615 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/da0fc323-6348-4b43-8162-b4031f2a5b2e-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-c2h58\" (UID: \"da0fc323-6348-4b43-8162-b4031f2a5b2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.490848 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.490823 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcld\" (UniqueName: \"kubernetes.io/projected/da0fc323-6348-4b43-8162-b4031f2a5b2e-kube-api-access-cwcld\") pod \"cert-manager-operator-controller-manager-54b9655956-c2h58\" (UID: \"da0fc323-6348-4b43-8162-b4031f2a5b2e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.673993 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.673919 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" Jun 02 02:02:07.809984 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.809875 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58"] Jun 02 02:02:07.813168 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:02:07.813138 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda0fc323_6348_4b43_8162_b4031f2a5b2e.slice/crio-9afffca804dc95f86c997cbc3fa82696bc92e0417e65d943183476e6692ea522 WatchSource:0}: Error finding container 9afffca804dc95f86c997cbc3fa82696bc92e0417e65d943183476e6692ea522: Status 404 returned error can't find the container with id 9afffca804dc95f86c997cbc3fa82696bc92e0417e65d943183476e6692ea522 Jun 02 02:02:07.816126 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:07.816111 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:02:08.274222 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:08.274183 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" event={"ID":"da0fc323-6348-4b43-8162-b4031f2a5b2e","Type":"ContainerStarted","Data":"9afffca804dc95f86c997cbc3fa82696bc92e0417e65d943183476e6692ea522"} Jun 02 02:02:12.290434 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:12.290389 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" event={"ID":"da0fc323-6348-4b43-8162-b4031f2a5b2e","Type":"ContainerStarted","Data":"2f5b93f2842ee30d3969917005d5e1788ae365df3df5e0886efb6fc8c7d294ed"} Jun 02 02:02:12.316967 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:12.316909 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-c2h58" podStartSLOduration=1.8050459220000001 podStartE2EDuration="5.316895447s" podCreationTimestamp="2026-06-02 02:02:07 +0000 UTC" firstStartedPulling="2026-06-02 02:02:07.816236038 +0000 UTC m=+337.315779683" lastFinishedPulling="2026-06-02 02:02:11.328085562 +0000 UTC m=+340.827629208" observedRunningTime="2026-06-02 02:02:12.313874295 +0000 UTC m=+341.813417959" watchObservedRunningTime="2026-06-02 02:02:12.316895447 +0000 UTC m=+341.816439114" Jun 02 02:02:17.555705 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.555654 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zlzlc"] Jun 02 02:02:17.559036 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.559019 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.561879 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.561856 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 02:02:17.563171 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.563151 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 02:02:17.563286 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.563182 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zzxwl\"" Jun 02 02:02:17.566941 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.566919 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zlzlc"] Jun 02 02:02:17.664748 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.664713 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f92e12b-e307-4b49-ab18-ee8073500a8c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zlzlc\" (UID: \"2f92e12b-e307-4b49-ab18-ee8073500a8c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.664748 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.664748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mdjp\" (UniqueName: \"kubernetes.io/projected/2f92e12b-e307-4b49-ab18-ee8073500a8c-kube-api-access-2mdjp\") pod \"cert-manager-cainjector-68b757865b-zlzlc\" (UID: \"2f92e12b-e307-4b49-ab18-ee8073500a8c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.766172 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.766136 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f92e12b-e307-4b49-ab18-ee8073500a8c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zlzlc\" (UID: \"2f92e12b-e307-4b49-ab18-ee8073500a8c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.766172 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.766174 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mdjp\" (UniqueName: \"kubernetes.io/projected/2f92e12b-e307-4b49-ab18-ee8073500a8c-kube-api-access-2mdjp\") pod \"cert-manager-cainjector-68b757865b-zlzlc\" (UID: \"2f92e12b-e307-4b49-ab18-ee8073500a8c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.775597 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.775570 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2f92e12b-e307-4b49-ab18-ee8073500a8c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-zlzlc\" (UID: \"2f92e12b-e307-4b49-ab18-ee8073500a8c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.775787 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.775769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mdjp\" (UniqueName: \"kubernetes.io/projected/2f92e12b-e307-4b49-ab18-ee8073500a8c-kube-api-access-2mdjp\") pod \"cert-manager-cainjector-68b757865b-zlzlc\" (UID: \"2f92e12b-e307-4b49-ab18-ee8073500a8c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:17.879184 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:17.879148 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" Jun 02 02:02:18.006507 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:18.006462 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-zlzlc"] Jun 02 02:02:18.008861 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:02:18.008833 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f92e12b_e307_4b49_ab18_ee8073500a8c.slice/crio-b9d9e9e9bd65a22f95d7069fdcb304d14039bb88927b442f80ee81bb1790874f WatchSource:0}: Error finding container b9d9e9e9bd65a22f95d7069fdcb304d14039bb88927b442f80ee81bb1790874f: Status 404 returned error can't find the container with id b9d9e9e9bd65a22f95d7069fdcb304d14039bb88927b442f80ee81bb1790874f Jun 02 02:02:18.309979 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:18.309893 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" event={"ID":"2f92e12b-e307-4b49-ab18-ee8073500a8c","Type":"ContainerStarted","Data":"b9d9e9e9bd65a22f95d7069fdcb304d14039bb88927b442f80ee81bb1790874f"} Jun 02 02:02:21.321198 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:21.321160 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" event={"ID":"2f92e12b-e307-4b49-ab18-ee8073500a8c","Type":"ContainerStarted","Data":"8200e8f614b05f07937ddf8621eb5de7468bf9e3352c01e436f05f89176801a8"} Jun 02 02:02:21.341351 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:21.341297 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-zlzlc" podStartSLOduration=1.132615948 podStartE2EDuration="4.341276768s" podCreationTimestamp="2026-06-02 02:02:17 +0000 UTC" firstStartedPulling="2026-06-02 02:02:18.010559247 +0000 UTC m=+347.510102905" lastFinishedPulling="2026-06-02 02:02:21.219220074 +0000 UTC m=+350.718763725" observedRunningTime="2026-06-02 02:02:21.340813997 +0000 UTC m=+350.840357664" watchObservedRunningTime="2026-06-02 02:02:21.341276768 +0000 UTC m=+350.840820434" Jun 02 02:02:32.755813 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.755767 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-zxgp8"] Jun 02 02:02:32.762822 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.762804 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:32.765636 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.765618 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9q9bq\"" Jun 02 02:02:32.769526 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.769414 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-zxgp8"] Jun 02 02:02:32.896988 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.896953 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62zh7\" (UniqueName: \"kubernetes.io/projected/65dcf342-a7db-4522-a08b-bfb2c9df49cc-kube-api-access-62zh7\") pod \"cert-manager-79c8d999ff-zxgp8\" (UID: \"65dcf342-a7db-4522-a08b-bfb2c9df49cc\") " pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:32.897159 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.897008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65dcf342-a7db-4522-a08b-bfb2c9df49cc-bound-sa-token\") pod \"cert-manager-79c8d999ff-zxgp8\" (UID: \"65dcf342-a7db-4522-a08b-bfb2c9df49cc\") " pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:32.997485 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.997449 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62zh7\" (UniqueName: \"kubernetes.io/projected/65dcf342-a7db-4522-a08b-bfb2c9df49cc-kube-api-access-62zh7\") pod \"cert-manager-79c8d999ff-zxgp8\" (UID: \"65dcf342-a7db-4522-a08b-bfb2c9df49cc\") " pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:32.997631 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:32.997498 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65dcf342-a7db-4522-a08b-bfb2c9df49cc-bound-sa-token\") pod \"cert-manager-79c8d999ff-zxgp8\" (UID: \"65dcf342-a7db-4522-a08b-bfb2c9df49cc\") " pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:33.008011 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.007955 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65dcf342-a7db-4522-a08b-bfb2c9df49cc-bound-sa-token\") pod \"cert-manager-79c8d999ff-zxgp8\" (UID: \"65dcf342-a7db-4522-a08b-bfb2c9df49cc\") " pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:33.008191 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.008169 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62zh7\" (UniqueName: \"kubernetes.io/projected/65dcf342-a7db-4522-a08b-bfb2c9df49cc-kube-api-access-62zh7\") pod \"cert-manager-79c8d999ff-zxgp8\" (UID: \"65dcf342-a7db-4522-a08b-bfb2c9df49cc\") " pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:33.071853 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.071817 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-zxgp8" Jun 02 02:02:33.197302 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.197273 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-zxgp8"] Jun 02 02:02:33.199387 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:02:33.199364 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65dcf342_a7db_4522_a08b_bfb2c9df49cc.slice/crio-ec85cba7ee1b33c78b8279ce20a1029bef6edeb850e397eb8e5ac7c3a33d36ea WatchSource:0}: Error finding container ec85cba7ee1b33c78b8279ce20a1029bef6edeb850e397eb8e5ac7c3a33d36ea: Status 404 returned error can't find the container with id ec85cba7ee1b33c78b8279ce20a1029bef6edeb850e397eb8e5ac7c3a33d36ea Jun 02 02:02:33.361271 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.361231 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-zxgp8" event={"ID":"65dcf342-a7db-4522-a08b-bfb2c9df49cc","Type":"ContainerStarted","Data":"4971b86191103fd8b14ce39fe7e534fb8b4589eb9c30328373e20f17aac956ed"} Jun 02 02:02:33.361271 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.361275 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-zxgp8" event={"ID":"65dcf342-a7db-4522-a08b-bfb2c9df49cc","Type":"ContainerStarted","Data":"ec85cba7ee1b33c78b8279ce20a1029bef6edeb850e397eb8e5ac7c3a33d36ea"} Jun 02 02:02:33.381308 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:33.381262 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-zxgp8" podStartSLOduration=1.381247791 podStartE2EDuration="1.381247791s" podCreationTimestamp="2026-06-02 02:02:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:02:33.380623124 +0000 UTC m=+362.880166791" watchObservedRunningTime="2026-06-02 02:02:33.381247791 +0000 UTC m=+362.880791458" Jun 02 02:02:49.896792 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.896760 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk"] Jun 02 02:02:49.900207 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.900180 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:49.905250 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.905229 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 02:02:49.905593 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.905575 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 02:02:49.906006 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.905991 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 02:02:49.906123 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.906035 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 02:02:49.906212 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.906150 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5mdh7\"" Jun 02 02:02:49.933041 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:49.933006 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk"] Jun 02 02:02:50.041617 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.041588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.041774 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.041622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-tmp\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.041774 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.041645 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.041774 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.041759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-manifests\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.041898 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.041798 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6dts\" (UniqueName: \"kubernetes.io/projected/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-kube-api-access-q6dts\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.142496 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.142460 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-manifests\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.142630 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.142513 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6dts\" (UniqueName: \"kubernetes.io/projected/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-kube-api-access-q6dts\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.142630 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.142561 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.142630 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.142593 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-tmp\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.142890 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.142751 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.142890 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.142883 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-manifests\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.145059 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.145036 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-tmp\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.145264 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.145246 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.145306 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.145264 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.158009 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.157953 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6dts\" (UniqueName: \"kubernetes.io/projected/d695516a-ae7e-4be9-b3f4-4f91afed8c5c-kube-api-access-q6dts\") pod \"opendatahub-operator-controller-manager-5d47575757-8qlrk\" (UID: \"d695516a-ae7e-4be9-b3f4-4f91afed8c5c\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.212395 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.212363 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:50.358623 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.358579 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk"] Jun 02 02:02:50.361689 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:02:50.361644 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd695516a_ae7e_4be9_b3f4_4f91afed8c5c.slice/crio-01b7d3cd9a971f11340ed76886019b335c315ab02693a5e6f22c4cf86152ade0 WatchSource:0}: Error finding container 01b7d3cd9a971f11340ed76886019b335c315ab02693a5e6f22c4cf86152ade0: Status 404 returned error can't find the container with id 01b7d3cd9a971f11340ed76886019b335c315ab02693a5e6f22c4cf86152ade0 Jun 02 02:02:50.420332 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:50.420271 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" event={"ID":"d695516a-ae7e-4be9-b3f4-4f91afed8c5c","Type":"ContainerStarted","Data":"01b7d3cd9a971f11340ed76886019b335c315ab02693a5e6f22c4cf86152ade0"} Jun 02 02:02:53.432792 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:53.432715 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" event={"ID":"d695516a-ae7e-4be9-b3f4-4f91afed8c5c","Type":"ContainerStarted","Data":"0e1823cc909ef8f4457f4f5691c482e0979c3d30e9d85438fe9caadcaacac1b3"} Jun 02 02:02:54.437825 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:54.437786 2579 generic.go:358] "Generic (PLEG): container finished" podID="d695516a-ae7e-4be9-b3f4-4f91afed8c5c" containerID="0e1823cc909ef8f4457f4f5691c482e0979c3d30e9d85438fe9caadcaacac1b3" exitCode=0 Jun 02 02:02:54.438226 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:54.437876 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" event={"ID":"d695516a-ae7e-4be9-b3f4-4f91afed8c5c","Type":"ContainerDied","Data":"0e1823cc909ef8f4457f4f5691c482e0979c3d30e9d85438fe9caadcaacac1b3"} Jun 02 02:02:55.443653 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:55.443616 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" event={"ID":"d695516a-ae7e-4be9-b3f4-4f91afed8c5c","Type":"ContainerStarted","Data":"0009816b3b9a97af0e63806395795fcdec2af19439bfe201c84affd05baa0955"} Jun 02 02:02:55.444070 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:55.443824 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:02:55.468188 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:02:55.468135 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" podStartSLOduration=2.059497938 podStartE2EDuration="6.468116519s" podCreationTimestamp="2026-06-02 02:02:49 +0000 UTC" firstStartedPulling="2026-06-02 02:02:50.363450217 +0000 UTC m=+379.862993862" lastFinishedPulling="2026-06-02 02:02:54.772068797 +0000 UTC m=+384.271612443" observedRunningTime="2026-06-02 02:02:55.467262298 +0000 UTC m=+384.966805964" watchObservedRunningTime="2026-06-02 02:02:55.468116519 +0000 UTC m=+384.967660188" Jun 02 02:03:06.449645 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:06.449609 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-8qlrk" Jun 02 02:03:10.124575 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.124544 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-96dcs"] Jun 02 02:03:10.133885 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.133860 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.136744 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.136720 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 02:03:10.137306 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.137283 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-96dcs"] Jun 02 02:03:10.213807 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.213777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee5fe47-0c20-4742-968f-06011dce7c6d-tls-certs\") pod \"model-serving-api-6577596cd5-96dcs\" (UID: \"6ee5fe47-0c20-4742-968f-06011dce7c6d\") " pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.214007 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.213969 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74psg\" (UniqueName: \"kubernetes.io/projected/6ee5fe47-0c20-4742-968f-06011dce7c6d-kube-api-access-74psg\") pod \"model-serving-api-6577596cd5-96dcs\" (UID: \"6ee5fe47-0c20-4742-968f-06011dce7c6d\") " pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.314915 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.314883 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74psg\" (UniqueName: \"kubernetes.io/projected/6ee5fe47-0c20-4742-968f-06011dce7c6d-kube-api-access-74psg\") pod \"model-serving-api-6577596cd5-96dcs\" (UID: \"6ee5fe47-0c20-4742-968f-06011dce7c6d\") " pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.315048 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.314921 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee5fe47-0c20-4742-968f-06011dce7c6d-tls-certs\") pod \"model-serving-api-6577596cd5-96dcs\" (UID: \"6ee5fe47-0c20-4742-968f-06011dce7c6d\") " pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.317401 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.317368 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ee5fe47-0c20-4742-968f-06011dce7c6d-tls-certs\") pod \"model-serving-api-6577596cd5-96dcs\" (UID: \"6ee5fe47-0c20-4742-968f-06011dce7c6d\") " pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.324021 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.323995 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74psg\" (UniqueName: \"kubernetes.io/projected/6ee5fe47-0c20-4742-968f-06011dce7c6d-kube-api-access-74psg\") pod \"model-serving-api-6577596cd5-96dcs\" (UID: \"6ee5fe47-0c20-4742-968f-06011dce7c6d\") " pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.444855 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.444777 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:10.587244 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:10.587220 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-96dcs"] Jun 02 02:03:10.590042 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:03:10.590019 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee5fe47_0c20_4742_968f_06011dce7c6d.slice/crio-95882ed833115f46c4df3fec3b1d231359c0f826a84f3c5cb1c1af137226f52d WatchSource:0}: Error finding container 95882ed833115f46c4df3fec3b1d231359c0f826a84f3c5cb1c1af137226f52d: Status 404 returned error can't find the container with id 95882ed833115f46c4df3fec3b1d231359c0f826a84f3c5cb1c1af137226f52d Jun 02 02:03:11.499050 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:11.498999 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-96dcs" event={"ID":"6ee5fe47-0c20-4742-968f-06011dce7c6d","Type":"ContainerStarted","Data":"95882ed833115f46c4df3fec3b1d231359c0f826a84f3c5cb1c1af137226f52d"} Jun 02 02:03:13.506845 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:13.506805 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-96dcs" event={"ID":"6ee5fe47-0c20-4742-968f-06011dce7c6d","Type":"ContainerStarted","Data":"a2a3d8b419e92cb8fefc79cc584bec51715913854d3288547d48197e60ce5994"} Jun 02 02:03:13.507321 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:13.506879 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:13.525239 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:13.525183 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-96dcs" podStartSLOduration=1.216523113 podStartE2EDuration="3.525169775s" podCreationTimestamp="2026-06-02 02:03:10 +0000 UTC" firstStartedPulling="2026-06-02 02:03:10.591996321 +0000 UTC m=+400.091539970" lastFinishedPulling="2026-06-02 02:03:12.900642987 +0000 UTC m=+402.400186632" observedRunningTime="2026-06-02 02:03:13.52304943 +0000 UTC m=+403.022593097" watchObservedRunningTime="2026-06-02 02:03:13.525169775 +0000 UTC m=+403.024713441" Jun 02 02:03:15.376829 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.376794 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9"] Jun 02 02:03:15.380259 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.380243 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.382958 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.382928 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 02:03:15.384271 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.384243 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qstwh\"" Jun 02 02:03:15.384271 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.384261 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 02:03:15.384450 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.384283 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 02:03:15.384450 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.384286 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 02:03:15.384450 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.384264 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:03:15.388701 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.388676 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9"] Jun 02 02:03:15.464263 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.464228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16e5b840-a772-46d6-8115-9b626e4604c7-manager-config\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.464463 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.464269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthxk\" (UniqueName: \"kubernetes.io/projected/16e5b840-a772-46d6-8115-9b626e4604c7-kube-api-access-nthxk\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.464463 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.464380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16e5b840-a772-46d6-8115-9b626e4604c7-cert\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.464463 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.464417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16e5b840-a772-46d6-8115-9b626e4604c7-metrics-cert\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.565836 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.565797 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16e5b840-a772-46d6-8115-9b626e4604c7-manager-config\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.565998 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.565846 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nthxk\" (UniqueName: \"kubernetes.io/projected/16e5b840-a772-46d6-8115-9b626e4604c7-kube-api-access-nthxk\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.565998 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.565906 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16e5b840-a772-46d6-8115-9b626e4604c7-cert\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.565998 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.565931 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16e5b840-a772-46d6-8115-9b626e4604c7-metrics-cert\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.566581 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.566559 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16e5b840-a772-46d6-8115-9b626e4604c7-manager-config\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.568485 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.568462 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16e5b840-a772-46d6-8115-9b626e4604c7-metrics-cert\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.568656 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.568636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16e5b840-a772-46d6-8115-9b626e4604c7-cert\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.578780 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.578760 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthxk\" (UniqueName: \"kubernetes.io/projected/16e5b840-a772-46d6-8115-9b626e4604c7-kube-api-access-nthxk\") pod \"lws-controller-manager-5fbdf7846d-ppgn9\" (UID: \"16e5b840-a772-46d6-8115-9b626e4604c7\") " pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.690025 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.689942 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:15.819857 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:15.819833 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9"] Jun 02 02:03:15.822234 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:03:15.822206 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16e5b840_a772_46d6_8115_9b626e4604c7.slice/crio-1dccf08560f7c7d7f89d6b7d2431768e123cbb7e7161be44a3ae3ffebad4a27a WatchSource:0}: Error finding container 1dccf08560f7c7d7f89d6b7d2431768e123cbb7e7161be44a3ae3ffebad4a27a: Status 404 returned error can't find the container with id 1dccf08560f7c7d7f89d6b7d2431768e123cbb7e7161be44a3ae3ffebad4a27a Jun 02 02:03:16.521635 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:16.521589 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" event={"ID":"16e5b840-a772-46d6-8115-9b626e4604c7","Type":"ContainerStarted","Data":"1dccf08560f7c7d7f89d6b7d2431768e123cbb7e7161be44a3ae3ffebad4a27a"} Jun 02 02:03:19.532059 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:19.532024 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" event={"ID":"16e5b840-a772-46d6-8115-9b626e4604c7","Type":"ContainerStarted","Data":"59f06611b2c9e76d2a9f7abf0cffeedff9048bbd1732a2fb5d32d27e146c654b"} Jun 02 02:03:19.532445 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:19.532096 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:19.585719 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:19.585602 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" podStartSLOduration=1.101013848 podStartE2EDuration="4.585587284s" podCreationTimestamp="2026-06-02 02:03:15 +0000 UTC" firstStartedPulling="2026-06-02 02:03:15.823958435 +0000 UTC m=+405.323502080" lastFinishedPulling="2026-06-02 02:03:19.308531859 +0000 UTC m=+408.808075516" observedRunningTime="2026-06-02 02:03:19.584833261 +0000 UTC m=+409.084376927" watchObservedRunningTime="2026-06-02 02:03:19.585587284 +0000 UTC m=+409.085130951" Jun 02 02:03:24.514471 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:24.514433 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-96dcs" Jun 02 02:03:30.538292 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:30.538258 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fbdf7846d-ppgn9" Jun 02 02:03:35.722878 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.722846 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-765cfc44cf-9zpbg"] Jun 02 02:03:35.727633 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.727616 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:35.730504 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.730482 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ppnnh\"" Jun 02 02:03:35.730739 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.730720 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 02:03:35.736542 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.736512 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-765cfc44cf-9zpbg"] Jun 02 02:03:35.845923 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.845890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c98bd687-ec68-426c-b720-9a029cbec984-redirect-config\") pod \"dashboard-redirect-765cfc44cf-9zpbg\" (UID: \"c98bd687-ec68-426c-b720-9a029cbec984\") " pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:35.846104 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.845941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwb2\" (UniqueName: \"kubernetes.io/projected/c98bd687-ec68-426c-b720-9a029cbec984-kube-api-access-nmwb2\") pod \"dashboard-redirect-765cfc44cf-9zpbg\" (UID: \"c98bd687-ec68-426c-b720-9a029cbec984\") " pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:35.946955 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.946921 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c98bd687-ec68-426c-b720-9a029cbec984-redirect-config\") pod \"dashboard-redirect-765cfc44cf-9zpbg\" (UID: \"c98bd687-ec68-426c-b720-9a029cbec984\") " pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:35.947120 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.946973 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwb2\" (UniqueName: \"kubernetes.io/projected/c98bd687-ec68-426c-b720-9a029cbec984-kube-api-access-nmwb2\") pod \"dashboard-redirect-765cfc44cf-9zpbg\" (UID: \"c98bd687-ec68-426c-b720-9a029cbec984\") " pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:35.947600 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.947580 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c98bd687-ec68-426c-b720-9a029cbec984-redirect-config\") pod \"dashboard-redirect-765cfc44cf-9zpbg\" (UID: \"c98bd687-ec68-426c-b720-9a029cbec984\") " pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:35.956730 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:35.956703 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwb2\" (UniqueName: \"kubernetes.io/projected/c98bd687-ec68-426c-b720-9a029cbec984-kube-api-access-nmwb2\") pod \"dashboard-redirect-765cfc44cf-9zpbg\" (UID: \"c98bd687-ec68-426c-b720-9a029cbec984\") " pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:36.037994 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:36.037924 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" Jun 02 02:03:36.167435 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:36.167407 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-765cfc44cf-9zpbg"] Jun 02 02:03:36.169443 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:03:36.169408 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98bd687_ec68_426c_b720_9a029cbec984.slice/crio-b6e7fa3a901fd33e19b979e6e9e19ab1b4545c92af8603b765e6608ddfaa717d WatchSource:0}: Error finding container b6e7fa3a901fd33e19b979e6e9e19ab1b4545c92af8603b765e6608ddfaa717d: Status 404 returned error can't find the container with id b6e7fa3a901fd33e19b979e6e9e19ab1b4545c92af8603b765e6608ddfaa717d Jun 02 02:03:36.589421 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:36.589388 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" event={"ID":"c98bd687-ec68-426c-b720-9a029cbec984","Type":"ContainerStarted","Data":"b6e7fa3a901fd33e19b979e6e9e19ab1b4545c92af8603b765e6608ddfaa717d"} Jun 02 02:03:38.599365 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:38.599325 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" event={"ID":"c98bd687-ec68-426c-b720-9a029cbec984","Type":"ContainerStarted","Data":"f664d96f26861fb23f519fe769e788fe8ff2804ef87a2a554c7f135ff123c5f0"} Jun 02 02:03:38.620177 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:38.620131 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-765cfc44cf-9zpbg" podStartSLOduration=1.279411671 podStartE2EDuration="3.620115574s" podCreationTimestamp="2026-06-02 02:03:35 +0000 UTC" firstStartedPulling="2026-06-02 02:03:36.170641399 +0000 UTC m=+425.670185044" lastFinishedPulling="2026-06-02 02:03:38.511345298 +0000 UTC m=+428.010888947" observedRunningTime="2026-06-02 02:03:38.617799505 +0000 UTC m=+428.117343174" watchObservedRunningTime="2026-06-02 02:03:38.620115574 +0000 UTC m=+428.119659240" Jun 02 02:03:51.271259 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.271175 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb"] Jun 02 02:03:51.274043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.274028 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.277538 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.277519 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c76rf\"" Jun 02 02:03:51.278742 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.278729 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 02:03:51.294397 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.294371 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb"] Jun 02 02:03:51.360083 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.360049 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h"] Jun 02 02:03:51.363162 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.363142 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.378618 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4621b0-1eff-448c-b757-4040f92629e3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378734 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378634 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4621b0-1eff-448c-b757-4040f92629e3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378734 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378674 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378734 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378878 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378878 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378878 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378818 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378878 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.378997 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.378908 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb8zc\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-kube-api-access-xb8zc\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.391652 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.391627 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h"] Jun 02 02:03:51.479936 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.479900 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.479946 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xb8zc\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-kube-api-access-xb8zc\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.479968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqj2x\" (UniqueName: \"kubernetes.io/projected/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-kube-api-access-bqj2x\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480023 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4621b0-1eff-448c-b757-4040f92629e3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480089 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4621b0-1eff-448c-b757-4040f92629e3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480107 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480122 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480142 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480166 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480260 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480310 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480359 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.480817 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480459 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480817 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480489 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480817 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480525 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480817 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.480817 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480732 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.481042 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480836 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4621b0-1eff-448c-b757-4040f92629e3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.481042 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480856 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.481042 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.480934 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.483051 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.483031 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.483190 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.483172 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4621b0-1eff-448c-b757-4040f92629e3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.491363 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.491337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb8zc\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-kube-api-access-xb8zc\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.498118 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.498099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44j74nb\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.581161 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581067 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqj2x\" (UniqueName: \"kubernetes.io/projected/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-kube-api-access-bqj2x\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581161 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581109 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581161 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581136 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581161 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581153 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581564 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581178 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581564 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581227 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581564 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581260 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581564 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581293 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581564 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581362 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581824 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581758 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581824 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581780 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581924 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581817 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581924 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581877 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.581988 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.581949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.583876 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.583857 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:51.584180 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.584146 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.584724 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.584390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.597292 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.597265 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqj2x\" (UniqueName: \"kubernetes.io/projected/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-kube-api-access-bqj2x\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.597450 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.597432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c8ce67f-adbf-4e9c-90a1-1962ccc04618-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bgql8h\" (UID: \"8c8ce67f-adbf-4e9c-90a1-1962ccc04618\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.673056 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.673020 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:51.733879 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.733853 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb"] Jun 02 02:03:51.735867 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:03:51.735836 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4621b0_1eff_448c_b757_4040f92629e3.slice/crio-d7dac60feada9ba2e6e0c75b59e7c53d19cd521201846bc7ae196acead459194 WatchSource:0}: Error finding container d7dac60feada9ba2e6e0c75b59e7c53d19cd521201846bc7ae196acead459194: Status 404 returned error can't find the container with id d7dac60feada9ba2e6e0c75b59e7c53d19cd521201846bc7ae196acead459194 Jun 02 02:03:51.826164 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:51.826137 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h"] Jun 02 02:03:51.826607 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:03:51.826584 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8ce67f_adbf_4e9c_90a1_1962ccc04618.slice/crio-5d7485e602b4aa3f4e6627012dd6bd24ace4520c72312fc03c5e60b3a9675732 WatchSource:0}: Error finding container 5d7485e602b4aa3f4e6627012dd6bd24ace4520c72312fc03c5e60b3a9675732: Status 404 returned error can't find the container with id 5d7485e602b4aa3f4e6627012dd6bd24ace4520c72312fc03c5e60b3a9675732 Jun 02 02:03:52.650908 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:52.650860 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" event={"ID":"8c8ce67f-adbf-4e9c-90a1-1962ccc04618","Type":"ContainerStarted","Data":"5d7485e602b4aa3f4e6627012dd6bd24ace4520c72312fc03c5e60b3a9675732"} Jun 02 02:03:52.652000 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:52.651962 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" event={"ID":"8f4621b0-1eff-448c-b757-4040f92629e3","Type":"ContainerStarted","Data":"d7dac60feada9ba2e6e0c75b59e7c53d19cd521201846bc7ae196acead459194"} Jun 02 02:03:54.761572 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:54.761527 2579 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 02 02:03:54.761964 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:54.761623 2579 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 02 02:03:54.761964 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:54.761649 2579 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 02 02:03:55.666956 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:55.666917 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" event={"ID":"8f4621b0-1eff-448c-b757-4040f92629e3","Type":"ContainerStarted","Data":"3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5"} Jun 02 02:03:55.688465 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:55.688416 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" podStartSLOduration=1.665011411 podStartE2EDuration="4.688401302s" podCreationTimestamp="2026-06-02 02:03:51 +0000 UTC" firstStartedPulling="2026-06-02 02:03:51.737845988 +0000 UTC m=+441.237389636" lastFinishedPulling="2026-06-02 02:03:54.761235871 +0000 UTC m=+444.260779527" observedRunningTime="2026-06-02 02:03:55.68772974 +0000 UTC m=+445.187273408" watchObservedRunningTime="2026-06-02 02:03:55.688401302 +0000 UTC m=+445.187944968" Jun 02 02:03:55.812984 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:55.812952 2579 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 02 02:03:55.813227 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:55.813023 2579 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 02 02:03:55.813227 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:55.813052 2579 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jun 02 02:03:56.584842 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.584799 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:03:56.586306 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.586276 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jun 02 02:03:56.586416 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.586332 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jun 02 02:03:56.671797 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.671760 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" event={"ID":"8c8ce67f-adbf-4e9c-90a1-1962ccc04618","Type":"ContainerStarted","Data":"2427e926c2954155f0880391a102e856c6ba679893348cde6ae37aaf122021c1"} Jun 02 02:03:56.674194 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.674177 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:56.678681 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.678645 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:56.693732 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:56.693688 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" podStartSLOduration=1.709487897 podStartE2EDuration="5.693655761s" podCreationTimestamp="2026-06-02 02:03:51 +0000 UTC" firstStartedPulling="2026-06-02 02:03:51.828471985 +0000 UTC m=+441.328015630" lastFinishedPulling="2026-06-02 02:03:55.812639847 +0000 UTC m=+445.312183494" observedRunningTime="2026-06-02 02:03:56.69248351 +0000 UTC m=+446.192027176" watchObservedRunningTime="2026-06-02 02:03:56.693655761 +0000 UTC m=+446.193199431" Jun 02 02:03:57.584434 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:57.584399 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jun 02 02:03:57.584874 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:57.584458 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jun 02 02:03:57.676142 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:57.676101 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:57.677215 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:57.677185 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bgql8h" Jun 02 02:03:57.731940 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:57.731910 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb"] Jun 02 02:03:58.584761 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:58.584721 2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jun 02 02:03:58.585149 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:58.584789 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jun 02 02:03:58.679575 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:03:58.679499 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" containerID="cri-o://3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5" gracePeriod=30 Jun 02 02:04:03.927315 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.927289 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:04:03.998473 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998381 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb8zc\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-kube-api-access-xb8zc\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998473 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998425 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-envoy\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998473 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998449 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-socket\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998473 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998465 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-certs\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998835 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998491 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4621b0-1eff-448c-b757-4040f92629e3-istiod-ca-cert\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998835 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998528 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-data\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998835 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998556 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4621b0-1eff-448c-b757-4040f92629e3-istio-podinfo\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998835 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998588 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-credential-socket\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998835 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998698 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-istio-token\") pod \"8f4621b0-1eff-448c-b757-4040f92629e3\" (UID: \"8f4621b0-1eff-448c-b757-4040f92629e3\") " Jun 02 02:04:03.998835 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998822 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:03.999134 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.998838 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:03.999134 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.999031 2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-socket\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:03.999134 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.999045 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:03.999134 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.999060 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:03.999134 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.999053 2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-workload-certs\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:03.999134 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:03.999091 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f4621b0-1eff-448c-b757-4040f92629e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:04:04.001016 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.000987 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:04.001123 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.001038 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-kube-api-access-xb8zc" (OuterVolumeSpecName: "kube-api-access-xb8zc") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "kube-api-access-xb8zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:04.001123 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.001050 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f4621b0-1eff-448c-b757-4040f92629e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 02 02:04:04.001123 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.001115 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f4621b0-1eff-448c-b757-4040f92629e3" (UID: "8f4621b0-1eff-448c-b757-4040f92629e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:04.099717 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099654 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-istio-token\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.099717 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099713 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb8zc\" (UniqueName: \"kubernetes.io/projected/8f4621b0-1eff-448c-b757-4040f92629e3-kube-api-access-xb8zc\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.099912 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099733 2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-envoy\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.099912 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099744 2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f4621b0-1eff-448c-b757-4040f92629e3-istiod-ca-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.099912 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099752 2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-istio-data\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.099912 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099760 2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f4621b0-1eff-448c-b757-4040f92629e3-istio-podinfo\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.099912 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.099769 2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f4621b0-1eff-448c-b757-4040f92629e3-credential-socket\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:04.702261 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.702221 2579 generic.go:358] "Generic (PLEG): container finished" podID="8f4621b0-1eff-448c-b757-4040f92629e3" containerID="3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5" exitCode=0 Jun 02 02:04:04.702436 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.702290 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" Jun 02 02:04:04.702436 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.702303 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" event={"ID":"8f4621b0-1eff-448c-b757-4040f92629e3","Type":"ContainerDied","Data":"3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5"} Jun 02 02:04:04.702436 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.702339 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb" event={"ID":"8f4621b0-1eff-448c-b757-4040f92629e3","Type":"ContainerDied","Data":"d7dac60feada9ba2e6e0c75b59e7c53d19cd521201846bc7ae196acead459194"} Jun 02 02:04:04.702436 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.702354 2579 scope.go:117] "RemoveContainer" containerID="3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5" Jun 02 02:04:04.710891 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.710876 2579 scope.go:117] "RemoveContainer" containerID="3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5" Jun 02 02:04:04.711169 ip-10-0-131-106 kubenswrapper[2579]: E0602 02:04:04.711148 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5\": container with ID starting with 3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5 not found: ID does not exist" containerID="3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5" Jun 02 02:04:04.711228 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.711188 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5"} err="failed to get container status \"3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5\": rpc error: code = NotFound desc = could not find container \"3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5\": container with ID starting with 3e9125744f61b8e43eb18f36972e7ec1f95f12ce937f963a8347ca96928af0c5 not found: ID does not exist" Jun 02 02:04:04.739166 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.739089 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb"] Jun 02 02:04:04.743023 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:04.742992 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44j74nb"] Jun 02 02:04:05.107834 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:05.107802 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" path="/var/lib/kubelet/pods/8f4621b0-1eff-448c-b757-4040f92629e3/volumes" Jun 02 02:04:10.364609 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.364577 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sff8b"] Jun 02 02:04:10.364982 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.364969 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" Jun 02 02:04:10.365033 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.364984 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" Jun 02 02:04:10.365068 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.365063 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="8f4621b0-1eff-448c-b757-4040f92629e3" containerName="istio-proxy" Jun 02 02:04:10.375163 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.375145 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:10.378007 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.377987 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:04:10.378238 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.378218 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2f7r2\"" Jun 02 02:04:10.378402 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.378376 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:04:10.380676 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.380634 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sff8b"] Jun 02 02:04:10.456962 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.456932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbwdb\" (UniqueName: \"kubernetes.io/projected/58216f97-e0c1-4045-adc0-30c2fc9d54f8-kube-api-access-lbwdb\") pod \"kuadrant-operator-catalog-sff8b\" (UID: \"58216f97-e0c1-4045-adc0-30c2fc9d54f8\") " pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:10.557575 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.557534 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbwdb\" (UniqueName: \"kubernetes.io/projected/58216f97-e0c1-4045-adc0-30c2fc9d54f8-kube-api-access-lbwdb\") pod \"kuadrant-operator-catalog-sff8b\" (UID: \"58216f97-e0c1-4045-adc0-30c2fc9d54f8\") " pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:10.567284 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.567256 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbwdb\" (UniqueName: \"kubernetes.io/projected/58216f97-e0c1-4045-adc0-30c2fc9d54f8-kube-api-access-lbwdb\") pod \"kuadrant-operator-catalog-sff8b\" (UID: \"58216f97-e0c1-4045-adc0-30c2fc9d54f8\") " pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:10.685834 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.685744 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:10.710296 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.710254 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sff8b"] Jun 02 02:04:10.819034 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.819001 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sff8b"] Jun 02 02:04:10.820129 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:04:10.820102 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58216f97_e0c1_4045_adc0_30c2fc9d54f8.slice/crio-2879814e809cfb8bf40009b694894ccd9114ce3e69aa32e8d9c4e852542cc24e WatchSource:0}: Error finding container 2879814e809cfb8bf40009b694894ccd9114ce3e69aa32e8d9c4e852542cc24e: Status 404 returned error can't find the container with id 2879814e809cfb8bf40009b694894ccd9114ce3e69aa32e8d9c4e852542cc24e Jun 02 02:04:10.919751 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.919717 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tdk7v"] Jun 02 02:04:10.924554 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.924534 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:10.934000 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:10.933979 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tdk7v"] Jun 02 02:04:11.062920 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.062837 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtcbt\" (UniqueName: \"kubernetes.io/projected/97c01e15-5371-494c-8e7c-f3ba32801c56-kube-api-access-vtcbt\") pod \"kuadrant-operator-catalog-tdk7v\" (UID: \"97c01e15-5371-494c-8e7c-f3ba32801c56\") " pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:11.163547 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.163506 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtcbt\" (UniqueName: \"kubernetes.io/projected/97c01e15-5371-494c-8e7c-f3ba32801c56-kube-api-access-vtcbt\") pod \"kuadrant-operator-catalog-tdk7v\" (UID: \"97c01e15-5371-494c-8e7c-f3ba32801c56\") " pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:11.173625 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.173594 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtcbt\" (UniqueName: \"kubernetes.io/projected/97c01e15-5371-494c-8e7c-f3ba32801c56-kube-api-access-vtcbt\") pod \"kuadrant-operator-catalog-tdk7v\" (UID: \"97c01e15-5371-494c-8e7c-f3ba32801c56\") " pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:11.235066 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.235024 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:11.381814 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.381783 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tdk7v"] Jun 02 02:04:11.384590 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:04:11.384562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c01e15_5371_494c_8e7c_f3ba32801c56.slice/crio-469c8e7d7950308d3188118d97965e253192e82a5802ec9f0d2a8c0badfec314 WatchSource:0}: Error finding container 469c8e7d7950308d3188118d97965e253192e82a5802ec9f0d2a8c0badfec314: Status 404 returned error can't find the container with id 469c8e7d7950308d3188118d97965e253192e82a5802ec9f0d2a8c0badfec314 Jun 02 02:04:11.731057 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.731021 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" event={"ID":"97c01e15-5371-494c-8e7c-f3ba32801c56","Type":"ContainerStarted","Data":"469c8e7d7950308d3188118d97965e253192e82a5802ec9f0d2a8c0badfec314"} Jun 02 02:04:11.732516 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:11.732483 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" event={"ID":"58216f97-e0c1-4045-adc0-30c2fc9d54f8","Type":"ContainerStarted","Data":"2879814e809cfb8bf40009b694894ccd9114ce3e69aa32e8d9c4e852542cc24e"} Jun 02 02:04:13.741237 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:13.741203 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" event={"ID":"58216f97-e0c1-4045-adc0-30c2fc9d54f8","Type":"ContainerStarted","Data":"2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f"} Jun 02 02:04:13.741627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:13.741261 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" podUID="58216f97-e0c1-4045-adc0-30c2fc9d54f8" containerName="registry-server" containerID="cri-o://2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f" gracePeriod=2 Jun 02 02:04:13.742778 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:13.742750 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" event={"ID":"97c01e15-5371-494c-8e7c-f3ba32801c56","Type":"ContainerStarted","Data":"80babd9211226f73e77d5a62d7d9c4b42c4ed34a0dff7e5403b3f9e007eb1c2c"} Jun 02 02:04:13.758995 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:13.758955 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" podStartSLOduration=1.823529691 podStartE2EDuration="3.758942782s" podCreationTimestamp="2026-06-02 02:04:10 +0000 UTC" firstStartedPulling="2026-06-02 02:04:10.821370224 +0000 UTC m=+460.320913868" lastFinishedPulling="2026-06-02 02:04:12.756783304 +0000 UTC m=+462.256326959" observedRunningTime="2026-06-02 02:04:13.75785226 +0000 UTC m=+463.257395928" watchObservedRunningTime="2026-06-02 02:04:13.758942782 +0000 UTC m=+463.258486446" Jun 02 02:04:13.781855 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:13.781797 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" podStartSLOduration=2.41047504 podStartE2EDuration="3.781781794s" podCreationTimestamp="2026-06-02 02:04:10 +0000 UTC" firstStartedPulling="2026-06-02 02:04:11.385984093 +0000 UTC m=+460.885527738" lastFinishedPulling="2026-06-02 02:04:12.757290838 +0000 UTC m=+462.256834492" observedRunningTime="2026-06-02 02:04:13.781034044 +0000 UTC m=+463.280577717" watchObservedRunningTime="2026-06-02 02:04:13.781781794 +0000 UTC m=+463.281325466" Jun 02 02:04:13.992116 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:13.992054 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:14.093752 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.093724 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbwdb\" (UniqueName: \"kubernetes.io/projected/58216f97-e0c1-4045-adc0-30c2fc9d54f8-kube-api-access-lbwdb\") pod \"58216f97-e0c1-4045-adc0-30c2fc9d54f8\" (UID: \"58216f97-e0c1-4045-adc0-30c2fc9d54f8\") " Jun 02 02:04:14.095935 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.095910 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58216f97-e0c1-4045-adc0-30c2fc9d54f8-kube-api-access-lbwdb" (OuterVolumeSpecName: "kube-api-access-lbwdb") pod "58216f97-e0c1-4045-adc0-30c2fc9d54f8" (UID: "58216f97-e0c1-4045-adc0-30c2fc9d54f8"). InnerVolumeSpecName "kube-api-access-lbwdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:14.194846 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.194811 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbwdb\" (UniqueName: \"kubernetes.io/projected/58216f97-e0c1-4045-adc0-30c2fc9d54f8-kube-api-access-lbwdb\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:04:14.747215 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.747176 2579 generic.go:358] "Generic (PLEG): container finished" podID="58216f97-e0c1-4045-adc0-30c2fc9d54f8" containerID="2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f" exitCode=0 Jun 02 02:04:14.747627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.747266 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" Jun 02 02:04:14.747627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.747270 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" event={"ID":"58216f97-e0c1-4045-adc0-30c2fc9d54f8","Type":"ContainerDied","Data":"2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f"} Jun 02 02:04:14.747627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.747315 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sff8b" event={"ID":"58216f97-e0c1-4045-adc0-30c2fc9d54f8","Type":"ContainerDied","Data":"2879814e809cfb8bf40009b694894ccd9114ce3e69aa32e8d9c4e852542cc24e"} Jun 02 02:04:14.747627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.747333 2579 scope.go:117] "RemoveContainer" containerID="2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f" Jun 02 02:04:14.756403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.756383 2579 scope.go:117] "RemoveContainer" containerID="2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f" Jun 02 02:04:14.756645 ip-10-0-131-106 kubenswrapper[2579]: E0602 02:04:14.756629 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f\": container with ID starting with 2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f not found: ID does not exist" containerID="2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f" Jun 02 02:04:14.756704 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.756653 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f"} err="failed to get container status \"2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f\": rpc error: code = NotFound desc = could not find container \"2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f\": container with ID starting with 2d2f11906274145e991a55d909f74c9f7e4d4bcdfc1e12265c3f2106fa7a7a4f not found: ID does not exist" Jun 02 02:04:14.771694 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.771655 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sff8b"] Jun 02 02:04:14.778286 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:14.778265 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sff8b"] Jun 02 02:04:15.107617 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:15.107577 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58216f97-e0c1-4045-adc0-30c2fc9d54f8" path="/var/lib/kubelet/pods/58216f97-e0c1-4045-adc0-30c2fc9d54f8/volumes" Jun 02 02:04:21.235643 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:21.235590 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:21.235643 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:21.235656 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:21.258690 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:21.258643 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:21.792816 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:21.792787 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tdk7v" Jun 02 02:04:37.262407 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.262367 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-j84tl"] Jun 02 02:04:37.262963 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.262943 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58216f97-e0c1-4045-adc0-30c2fc9d54f8" containerName="registry-server" Jun 02 02:04:37.263051 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.262966 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="58216f97-e0c1-4045-adc0-30c2fc9d54f8" containerName="registry-server" Jun 02 02:04:37.263109 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.263076 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="58216f97-e0c1-4045-adc0-30c2fc9d54f8" containerName="registry-server" Jun 02 02:04:37.272609 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.272586 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:37.276424 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.276398 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rrmk9\"" Jun 02 02:04:37.276920 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.276899 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-j84tl"] Jun 02 02:04:37.295618 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.295587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgmqq\" (UniqueName: \"kubernetes.io/projected/30f57cec-4c40-4759-b51f-751c5d17e328-kube-api-access-jgmqq\") pod \"authorino-operator-657f44b778-j84tl\" (UID: \"30f57cec-4c40-4759-b51f-751c5d17e328\") " pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:37.396122 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.396079 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgmqq\" (UniqueName: \"kubernetes.io/projected/30f57cec-4c40-4759-b51f-751c5d17e328-kube-api-access-jgmqq\") pod \"authorino-operator-657f44b778-j84tl\" (UID: \"30f57cec-4c40-4759-b51f-751c5d17e328\") " pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:37.404952 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.404920 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgmqq\" (UniqueName: \"kubernetes.io/projected/30f57cec-4c40-4759-b51f-751c5d17e328-kube-api-access-jgmqq\") pod \"authorino-operator-657f44b778-j84tl\" (UID: \"30f57cec-4c40-4759-b51f-751c5d17e328\") " pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:37.585627 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.585531 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:37.724906 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.724878 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-j84tl"] Jun 02 02:04:37.726058 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:04:37.726034 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f57cec_4c40_4759_b51f_751c5d17e328.slice/crio-fe28d876b655d9bb44aa7956cbba8b9b5b58160bd5a8ba2895dfead1621c600c WatchSource:0}: Error finding container fe28d876b655d9bb44aa7956cbba8b9b5b58160bd5a8ba2895dfead1621c600c: Status 404 returned error can't find the container with id fe28d876b655d9bb44aa7956cbba8b9b5b58160bd5a8ba2895dfead1621c600c Jun 02 02:04:37.827733 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:37.827696 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" event={"ID":"30f57cec-4c40-4759-b51f-751c5d17e328","Type":"ContainerStarted","Data":"fe28d876b655d9bb44aa7956cbba8b9b5b58160bd5a8ba2895dfead1621c600c"} Jun 02 02:04:40.841365 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:40.841330 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" event={"ID":"30f57cec-4c40-4759-b51f-751c5d17e328","Type":"ContainerStarted","Data":"103a3e2af0948f66c7f12b47a9231effde02eda2ca90ea0233c5c5372668c473"} Jun 02 02:04:40.841754 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:40.841407 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:40.866481 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:40.866436 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" podStartSLOduration=1.6989445810000001 podStartE2EDuration="3.866419974s" podCreationTimestamp="2026-06-02 02:04:37 +0000 UTC" firstStartedPulling="2026-06-02 02:04:37.728041425 +0000 UTC m=+487.227585069" lastFinishedPulling="2026-06-02 02:04:39.895516814 +0000 UTC m=+489.395060462" observedRunningTime="2026-06-02 02:04:40.865011072 +0000 UTC m=+490.364554739" watchObservedRunningTime="2026-06-02 02:04:40.866419974 +0000 UTC m=+490.365963640" Jun 02 02:04:46.486771 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.486737 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt"] Jun 02 02:04:46.494941 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.494923 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:04:46.498445 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.498420 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c52wp\"" Jun 02 02:04:46.499065 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.499045 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt"] Jun 02 02:04:46.584936 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.584906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hh7\" (UniqueName: \"kubernetes.io/projected/051b7f03-76bc-40a7-a5d5-af02bde74bc1-kube-api-access-75hh7\") pod \"limitador-operator-controller-manager-85c4996f8c-qtczt\" (UID: \"051b7f03-76bc-40a7-a5d5-af02bde74bc1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:04:46.686277 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.686245 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75hh7\" (UniqueName: \"kubernetes.io/projected/051b7f03-76bc-40a7-a5d5-af02bde74bc1-kube-api-access-75hh7\") pod \"limitador-operator-controller-manager-85c4996f8c-qtczt\" (UID: \"051b7f03-76bc-40a7-a5d5-af02bde74bc1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:04:46.698699 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.698646 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hh7\" (UniqueName: \"kubernetes.io/projected/051b7f03-76bc-40a7-a5d5-af02bde74bc1-kube-api-access-75hh7\") pod \"limitador-operator-controller-manager-85c4996f8c-qtczt\" (UID: \"051b7f03-76bc-40a7-a5d5-af02bde74bc1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:04:46.807049 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.806956 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:04:46.941801 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:46.941775 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt"] Jun 02 02:04:46.944590 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:04:46.944562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051b7f03_76bc_40a7_a5d5_af02bde74bc1.slice/crio-cef095465ff7f9540dc682c96dc16ab22ca922a0d68739254a0faaad25996fec WatchSource:0}: Error finding container cef095465ff7f9540dc682c96dc16ab22ca922a0d68739254a0faaad25996fec: Status 404 returned error can't find the container with id cef095465ff7f9540dc682c96dc16ab22ca922a0d68739254a0faaad25996fec Jun 02 02:04:47.867154 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:47.867120 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" event={"ID":"051b7f03-76bc-40a7-a5d5-af02bde74bc1","Type":"ContainerStarted","Data":"cef095465ff7f9540dc682c96dc16ab22ca922a0d68739254a0faaad25996fec"} Jun 02 02:04:48.871314 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:48.871287 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" event={"ID":"051b7f03-76bc-40a7-a5d5-af02bde74bc1","Type":"ContainerStarted","Data":"445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215"} Jun 02 02:04:48.871593 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:48.871400 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:04:48.887101 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:48.887061 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" podStartSLOduration=1.026590034 podStartE2EDuration="2.88705045s" podCreationTimestamp="2026-06-02 02:04:46 +0000 UTC" firstStartedPulling="2026-06-02 02:04:46.946510748 +0000 UTC m=+496.446054408" lastFinishedPulling="2026-06-02 02:04:48.806971169 +0000 UTC m=+498.306514824" observedRunningTime="2026-06-02 02:04:48.886977482 +0000 UTC m=+498.386521150" watchObservedRunningTime="2026-06-02 02:04:48.88705045 +0000 UTC m=+498.386594116" Jun 02 02:04:51.847147 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:51.847116 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-j84tl" Jun 02 02:04:59.877319 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:04:59.877288 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:05:03.378098 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.378061 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt"] Jun 02 02:05:03.378559 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.378314 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" containerName="manager" containerID="cri-o://445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215" gracePeriod=2 Jun 02 02:05:03.385655 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.385626 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt"] Jun 02 02:05:03.413156 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.413122 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd"] Jun 02 02:05:03.413758 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.413737 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" containerName="manager" Jun 02 02:05:03.413838 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.413760 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" containerName="manager" Jun 02 02:05:03.413892 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.413880 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" containerName="manager" Jun 02 02:05:03.417245 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.417226 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:03.420949 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.420918 2579 status_manager.go:895] "Failed to get status for pod" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" err="pods \"limitador-operator-controller-manager-85c4996f8c-qtczt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" Jun 02 02:05:03.428233 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.428207 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd"] Jun 02 02:05:03.540471 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.540438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnf9f\" (UniqueName: \"kubernetes.io/projected/1bdf54d1-1961-44a6-9578-42e125d48c4e-kube-api-access-qnf9f\") pod \"limitador-operator-controller-manager-85c4996f8c-jbxpd\" (UID: \"1bdf54d1-1961-44a6-9578-42e125d48c4e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:03.616230 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.616206 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:05:03.620301 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.620276 2579 status_manager.go:895] "Failed to get status for pod" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" err="pods \"limitador-operator-controller-manager-85c4996f8c-qtczt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" Jun 02 02:05:03.641284 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.641214 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnf9f\" (UniqueName: \"kubernetes.io/projected/1bdf54d1-1961-44a6-9578-42e125d48c4e-kube-api-access-qnf9f\") pod \"limitador-operator-controller-manager-85c4996f8c-jbxpd\" (UID: \"1bdf54d1-1961-44a6-9578-42e125d48c4e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:03.651403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.651383 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnf9f\" (UniqueName: \"kubernetes.io/projected/1bdf54d1-1961-44a6-9578-42e125d48c4e-kube-api-access-qnf9f\") pod \"limitador-operator-controller-manager-85c4996f8c-jbxpd\" (UID: \"1bdf54d1-1961-44a6-9578-42e125d48c4e\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:03.741548 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.741519 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75hh7\" (UniqueName: \"kubernetes.io/projected/051b7f03-76bc-40a7-a5d5-af02bde74bc1-kube-api-access-75hh7\") pod \"051b7f03-76bc-40a7-a5d5-af02bde74bc1\" (UID: \"051b7f03-76bc-40a7-a5d5-af02bde74bc1\") " Jun 02 02:05:03.743654 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.743630 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/051b7f03-76bc-40a7-a5d5-af02bde74bc1-kube-api-access-75hh7" (OuterVolumeSpecName: "kube-api-access-75hh7") pod "051b7f03-76bc-40a7-a5d5-af02bde74bc1" (UID: "051b7f03-76bc-40a7-a5d5-af02bde74bc1"). InnerVolumeSpecName "kube-api-access-75hh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:05:03.745761 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.745742 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:03.843063 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.843027 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75hh7\" (UniqueName: \"kubernetes.io/projected/051b7f03-76bc-40a7-a5d5-af02bde74bc1-kube-api-access-75hh7\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:03.894374 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.894345 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd"] Jun 02 02:05:03.896101 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:05:03.896076 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdf54d1_1961_44a6_9578_42e125d48c4e.slice/crio-cebdb7302d9be7f4b769d87a3c872ccc180b409c83c8b3ee6203adefd29c5624 WatchSource:0}: Error finding container cebdb7302d9be7f4b769d87a3c872ccc180b409c83c8b3ee6203adefd29c5624: Status 404 returned error can't find the container with id cebdb7302d9be7f4b769d87a3c872ccc180b409c83c8b3ee6203adefd29c5624 Jun 02 02:05:03.925870 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.925839 2579 generic.go:358] "Generic (PLEG): container finished" podID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" containerID="445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215" exitCode=0 Jun 02 02:05:03.925967 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.925884 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" Jun 02 02:05:03.925967 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.925918 2579 scope.go:117] "RemoveContainer" containerID="445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215" Jun 02 02:05:03.927228 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.927206 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" event={"ID":"1bdf54d1-1961-44a6-9578-42e125d48c4e","Type":"ContainerStarted","Data":"cebdb7302d9be7f4b769d87a3c872ccc180b409c83c8b3ee6203adefd29c5624"} Jun 02 02:05:03.928558 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.928533 2579 status_manager.go:895] "Failed to get status for pod" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" err="pods \"limitador-operator-controller-manager-85c4996f8c-qtczt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" Jun 02 02:05:03.936200 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.936167 2579 scope.go:117] "RemoveContainer" containerID="445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215" Jun 02 02:05:03.936500 ip-10-0-131-106 kubenswrapper[2579]: E0602 02:05:03.936470 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215\": container with ID starting with 445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215 not found: ID does not exist" containerID="445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215" Jun 02 02:05:03.936585 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.936500 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215"} err="failed to get container status \"445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215\": rpc error: code = NotFound desc = could not find container \"445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215\": container with ID starting with 445e14520d48d07cecc9b1ba830be93081b56d7f91b396bd42e545f859e58215 not found: ID does not exist" Jun 02 02:05:03.949065 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:03.949037 2579 status_manager.go:895] "Failed to get status for pod" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" err="pods \"limitador-operator-controller-manager-85c4996f8c-qtczt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" Jun 02 02:05:04.932234 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:04.932196 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" event={"ID":"1bdf54d1-1961-44a6-9578-42e125d48c4e","Type":"ContainerStarted","Data":"9660c996c3fd37f62a0ae6581ffdcc02925762ba23d3951970f66157c9c06700"} Jun 02 02:05:04.932636 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:04.932251 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:04.934785 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:04.934761 2579 status_manager.go:895] "Failed to get status for pod" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qtczt" err="pods \"limitador-operator-controller-manager-85c4996f8c-qtczt\" is forbidden: User \"system:node:ip-10-0-131-106.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-106.ec2.internal' and this object" Jun 02 02:05:04.958176 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:04.958119 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" podStartSLOduration=1.958105716 podStartE2EDuration="1.958105716s" podCreationTimestamp="2026-06-02 02:05:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:05:04.956962048 +0000 UTC m=+514.456505720" watchObservedRunningTime="2026-06-02 02:05:04.958105716 +0000 UTC m=+514.457649452" Jun 02 02:05:05.107428 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:05.107391 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="051b7f03-76bc-40a7-a5d5-af02bde74bc1" path="/var/lib/kubelet/pods/051b7f03-76bc-40a7-a5d5-af02bde74bc1/volumes" Jun 02 02:05:08.658829 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.658793 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-674555986-86f5n"] Jun 02 02:05:08.662467 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.662448 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.675593 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.675566 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674555986-86f5n"] Jun 02 02:05:08.789226 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-service-ca\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.789403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-trusted-ca-bundle\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.789403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-console-config\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.789403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789283 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12edba3d-46b2-412d-92ea-608e125f7668-console-oauth-config\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.789403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789299 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xt5k\" (UniqueName: \"kubernetes.io/projected/12edba3d-46b2-412d-92ea-608e125f7668-kube-api-access-7xt5k\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.789403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789318 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12edba3d-46b2-412d-92ea-608e125f7668-console-serving-cert\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.789403 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.789369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-oauth-serving-cert\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890270 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890230 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-console-config\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890270 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890275 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12edba3d-46b2-412d-92ea-608e125f7668-console-oauth-config\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890519 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890303 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xt5k\" (UniqueName: \"kubernetes.io/projected/12edba3d-46b2-412d-92ea-608e125f7668-kube-api-access-7xt5k\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890519 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890333 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12edba3d-46b2-412d-92ea-608e125f7668-console-serving-cert\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890519 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890368 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-oauth-serving-cert\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890519 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890449 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-service-ca\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.890519 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.890504 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-trusted-ca-bundle\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.891104 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.891075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-console-config\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.891259 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.891220 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-oauth-serving-cert\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.891259 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.891211 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-service-ca\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.891575 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.891552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12edba3d-46b2-412d-92ea-608e125f7668-trusted-ca-bundle\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.893037 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.893010 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12edba3d-46b2-412d-92ea-608e125f7668-console-serving-cert\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.893130 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.893075 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12edba3d-46b2-412d-92ea-608e125f7668-console-oauth-config\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.900772 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.900750 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xt5k\" (UniqueName: \"kubernetes.io/projected/12edba3d-46b2-412d-92ea-608e125f7668-kube-api-access-7xt5k\") pod \"console-674555986-86f5n\" (UID: \"12edba3d-46b2-412d-92ea-608e125f7668\") " pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:08.972366 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:08.972295 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:09.101201 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:09.101123 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-674555986-86f5n"] Jun 02 02:05:09.103836 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:05:09.103807 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12edba3d_46b2_412d_92ea_608e125f7668.slice/crio-e40f46f18e88b9e5bc5887f1444690231ae49213dfa330a3a350c93a5573ffc2 WatchSource:0}: Error finding container e40f46f18e88b9e5bc5887f1444690231ae49213dfa330a3a350c93a5573ffc2: Status 404 returned error can't find the container with id e40f46f18e88b9e5bc5887f1444690231ae49213dfa330a3a350c93a5573ffc2 Jun 02 02:05:09.951166 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:09.951130 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674555986-86f5n" event={"ID":"12edba3d-46b2-412d-92ea-608e125f7668","Type":"ContainerStarted","Data":"8703db239265ae5eb3a98a2491c0b0b6814503ca0ee8c029f58a149d4187cec0"} Jun 02 02:05:09.951166 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:09.951166 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-674555986-86f5n" event={"ID":"12edba3d-46b2-412d-92ea-608e125f7668","Type":"ContainerStarted","Data":"e40f46f18e88b9e5bc5887f1444690231ae49213dfa330a3a350c93a5573ffc2"} Jun 02 02:05:09.974103 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:09.974054 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-674555986-86f5n" podStartSLOduration=1.974039042 podStartE2EDuration="1.974039042s" podCreationTimestamp="2026-06-02 02:05:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:05:09.973243694 +0000 UTC m=+519.472787362" watchObservedRunningTime="2026-06-02 02:05:09.974039042 +0000 UTC m=+519.473582775" Jun 02 02:05:15.939690 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:15.939613 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jbxpd" Jun 02 02:05:18.972496 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:18.972404 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:18.972496 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:18.972476 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:18.977058 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:18.977039 2579 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:18.988936 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:18.988909 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-674555986-86f5n" Jun 02 02:05:19.051715 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:19.051682 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5766474fcc-wd8th"] Jun 02 02:05:44.079372 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.079318 2579 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5766474fcc-wd8th" podUID="234492df-8bee-4bdb-a0a5-dabc052ac50d" containerName="console" containerID="cri-o://457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd" gracePeriod=15 Jun 02 02:05:44.330368 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.330316 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5766474fcc-wd8th_234492df-8bee-4bdb-a0a5-dabc052ac50d/console/0.log" Jun 02 02:05:44.330463 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.330381 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:05:44.406289 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406259 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-service-ca\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406289 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406290 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-oauth-config\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406492 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406325 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-oauth-serving-cert\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406492 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406348 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-trusted-ca-bundle\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406492 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406371 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp46n\" (UniqueName: \"kubernetes.io/projected/234492df-8bee-4bdb-a0a5-dabc052ac50d-kube-api-access-xp46n\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406492 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406400 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-serving-cert\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406492 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406457 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-config\") pod \"234492df-8bee-4bdb-a0a5-dabc052ac50d\" (UID: \"234492df-8bee-4bdb-a0a5-dabc052ac50d\") " Jun 02 02:05:44.406773 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406708 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-service-ca" (OuterVolumeSpecName: "service-ca") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:05:44.406924 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406896 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:05:44.406991 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406921 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:05:44.407063 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.406994 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-config" (OuterVolumeSpecName: "console-config") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:05:44.408602 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.408572 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:05:44.408713 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.408679 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234492df-8bee-4bdb-a0a5-dabc052ac50d-kube-api-access-xp46n" (OuterVolumeSpecName: "kube-api-access-xp46n") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "kube-api-access-xp46n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:05:44.408885 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.408866 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "234492df-8bee-4bdb-a0a5-dabc052ac50d" (UID: "234492df-8bee-4bdb-a0a5-dabc052ac50d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 02:05:44.507752 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507722 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp46n\" (UniqueName: \"kubernetes.io/projected/234492df-8bee-4bdb-a0a5-dabc052ac50d-kube-api-access-xp46n\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.507752 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507750 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.507752 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507761 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.507963 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507770 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-service-ca\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.507963 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507778 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/234492df-8bee-4bdb-a0a5-dabc052ac50d-console-oauth-config\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.507963 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507787 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-oauth-serving-cert\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.507963 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.507795 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/234492df-8bee-4bdb-a0a5-dabc052ac50d-trusted-ca-bundle\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:05:44.976782 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.976743 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:05:44.977231 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.977212 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234492df-8bee-4bdb-a0a5-dabc052ac50d" containerName="console" Jun 02 02:05:44.977323 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.977233 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="234492df-8bee-4bdb-a0a5-dabc052ac50d" containerName="console" Jun 02 02:05:44.977379 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.977370 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="234492df-8bee-4bdb-a0a5-dabc052ac50d" containerName="console" Jun 02 02:05:44.981572 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.981549 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:44.984589 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.984567 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 02:05:44.984701 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.984652 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-glzsz\"" Jun 02 02:05:44.989256 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:44.989228 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:05:45.005882 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.005856 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:05:45.073894 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.073867 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5766474fcc-wd8th_234492df-8bee-4bdb-a0a5-dabc052ac50d/console/0.log" Jun 02 02:05:45.074043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.073908 2579 generic.go:358] "Generic (PLEG): container finished" podID="234492df-8bee-4bdb-a0a5-dabc052ac50d" containerID="457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd" exitCode=2 Jun 02 02:05:45.074043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.073954 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5766474fcc-wd8th" event={"ID":"234492df-8bee-4bdb-a0a5-dabc052ac50d","Type":"ContainerDied","Data":"457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd"} Jun 02 02:05:45.074043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.073977 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5766474fcc-wd8th" Jun 02 02:05:45.074043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.073989 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5766474fcc-wd8th" event={"ID":"234492df-8bee-4bdb-a0a5-dabc052ac50d","Type":"ContainerDied","Data":"f19164d861e50b5ade18f8efee5e01ab98bc7be01f1eec7500213d0d27e95187"} Jun 02 02:05:45.074043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.074005 2579 scope.go:117] "RemoveContainer" containerID="457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd" Jun 02 02:05:45.082714 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.082538 2579 scope.go:117] "RemoveContainer" containerID="457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd" Jun 02 02:05:45.082966 ip-10-0-131-106 kubenswrapper[2579]: E0602 02:05:45.082822 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd\": container with ID starting with 457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd not found: ID does not exist" containerID="457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd" Jun 02 02:05:45.082966 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.082855 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd"} err="failed to get container status \"457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd\": rpc error: code = NotFound desc = could not find container \"457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd\": container with ID starting with 457a66423fd709f15f9e954493770cf124303139be890c2b40b44e2e47c963bd not found: ID does not exist" Jun 02 02:05:45.098536 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.098514 2579 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5766474fcc-wd8th"] Jun 02 02:05:45.100255 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.100237 2579 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5766474fcc-wd8th"] Jun 02 02:05:45.108077 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.108057 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="234492df-8bee-4bdb-a0a5-dabc052ac50d" path="/var/lib/kubelet/pods/234492df-8bee-4bdb-a0a5-dabc052ac50d/volumes" Jun 02 02:05:45.113624 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.113600 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnnfm\" (UniqueName: \"kubernetes.io/projected/e35832b7-2df5-492e-8bad-f64cc0471888-kube-api-access-lnnfm\") pod \"limitador-limitador-78c99df468-cdxdh\" (UID: \"e35832b7-2df5-492e-8bad-f64cc0471888\") " pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.113745 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.113683 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e35832b7-2df5-492e-8bad-f64cc0471888-config-file\") pod \"limitador-limitador-78c99df468-cdxdh\" (UID: \"e35832b7-2df5-492e-8bad-f64cc0471888\") " pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.214117 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.214092 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e35832b7-2df5-492e-8bad-f64cc0471888-config-file\") pod \"limitador-limitador-78c99df468-cdxdh\" (UID: \"e35832b7-2df5-492e-8bad-f64cc0471888\") " pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.214242 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.214141 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnnfm\" (UniqueName: \"kubernetes.io/projected/e35832b7-2df5-492e-8bad-f64cc0471888-kube-api-access-lnnfm\") pod \"limitador-limitador-78c99df468-cdxdh\" (UID: \"e35832b7-2df5-492e-8bad-f64cc0471888\") " pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.214764 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.214744 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e35832b7-2df5-492e-8bad-f64cc0471888-config-file\") pod \"limitador-limitador-78c99df468-cdxdh\" (UID: \"e35832b7-2df5-492e-8bad-f64cc0471888\") " pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.222327 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.222310 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnnfm\" (UniqueName: \"kubernetes.io/projected/e35832b7-2df5-492e-8bad-f64cc0471888-kube-api-access-lnnfm\") pod \"limitador-limitador-78c99df468-cdxdh\" (UID: \"e35832b7-2df5-492e-8bad-f64cc0471888\") " pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.293043 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.292978 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:45.425919 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:45.425890 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:05:45.428106 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:05:45.428078 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35832b7_2df5_492e_8bad_f64cc0471888.slice/crio-c277247bfd0cf47793613043cd2430ee3732909b78e6a58d31f672d18825ca5f WatchSource:0}: Error finding container c277247bfd0cf47793613043cd2430ee3732909b78e6a58d31f672d18825ca5f: Status 404 returned error can't find the container with id c277247bfd0cf47793613043cd2430ee3732909b78e6a58d31f672d18825ca5f Jun 02 02:05:46.080656 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:46.080616 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" event={"ID":"e35832b7-2df5-492e-8bad-f64cc0471888","Type":"ContainerStarted","Data":"c277247bfd0cf47793613043cd2430ee3732909b78e6a58d31f672d18825ca5f"} Jun 02 02:05:48.088646 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:48.088614 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" event={"ID":"e35832b7-2df5-492e-8bad-f64cc0471888","Type":"ContainerStarted","Data":"9c3fcddc5aa48cf53fe0b231bfcf7f745a6de050915a72852d66a17a41dc0cb2"} Jun 02 02:05:48.089098 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:48.088707 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:59.092511 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:59.092480 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" Jun 02 02:05:59.114207 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:05:59.114147 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-cdxdh" podStartSLOduration=12.681151298 podStartE2EDuration="15.114134644s" podCreationTimestamp="2026-06-02 02:05:44 +0000 UTC" firstStartedPulling="2026-06-02 02:05:45.429978803 +0000 UTC m=+554.929522447" lastFinishedPulling="2026-06-02 02:05:47.862962147 +0000 UTC m=+557.362505793" observedRunningTime="2026-06-02 02:05:48.107369549 +0000 UTC m=+557.606913215" watchObservedRunningTime="2026-06-02 02:05:59.114134644 +0000 UTC m=+568.613678310" Jun 02 02:07:46.663374 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.663335 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-w88qj"] Jun 02 02:07:46.667065 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.667048 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:07:46.669925 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.669901 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 02:07:46.677321 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.677300 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-w88qj"] Jun 02 02:07:46.806860 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.806827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsz8f\" (UniqueName: \"kubernetes.io/projected/79be1f60-7fc4-4683-8a15-eedbdd2c6505-kube-api-access-hsz8f\") pod \"payload-processing-58b6c8fdc7-w88qj\" (UID: \"79be1f60-7fc4-4683-8a15-eedbdd2c6505\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:07:46.828334 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.828300 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:07:46.907685 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.907632 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsz8f\" (UniqueName: \"kubernetes.io/projected/79be1f60-7fc4-4683-8a15-eedbdd2c6505-kube-api-access-hsz8f\") pod \"payload-processing-58b6c8fdc7-w88qj\" (UID: \"79be1f60-7fc4-4683-8a15-eedbdd2c6505\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:07:46.916773 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.916707 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsz8f\" (UniqueName: \"kubernetes.io/projected/79be1f60-7fc4-4683-8a15-eedbdd2c6505-kube-api-access-hsz8f\") pod \"payload-processing-58b6c8fdc7-w88qj\" (UID: \"79be1f60-7fc4-4683-8a15-eedbdd2c6505\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:07:46.978633 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:46.978595 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:07:47.117350 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:47.117325 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-w88qj"] Jun 02 02:07:47.120055 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:07:47.120027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79be1f60_7fc4_4683_8a15_eedbdd2c6505.slice/crio-af710e1f51497fc8e4ee63b86e5f61a20ca6d3c2b760de230b94cb304150e791 WatchSource:0}: Error finding container af710e1f51497fc8e4ee63b86e5f61a20ca6d3c2b760de230b94cb304150e791: Status 404 returned error can't find the container with id af710e1f51497fc8e4ee63b86e5f61a20ca6d3c2b760de230b94cb304150e791 Jun 02 02:07:47.121724 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:47.121705 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:07:47.511629 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:47.511593 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" event={"ID":"79be1f60-7fc4-4683-8a15-eedbdd2c6505","Type":"ContainerStarted","Data":"af710e1f51497fc8e4ee63b86e5f61a20ca6d3c2b760de230b94cb304150e791"} Jun 02 02:07:50.526290 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:50.526249 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" event={"ID":"79be1f60-7fc4-4683-8a15-eedbdd2c6505","Type":"ContainerStarted","Data":"4d21c803b5b0a656d07a3641fa3908ccb6874360e7c5de38ed13e83af8ab1f37"} Jun 02 02:07:50.526709 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:50.526335 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:07:50.545622 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:07:50.545562 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" podStartSLOduration=2.188505418 podStartE2EDuration="4.54554589s" podCreationTimestamp="2026-06-02 02:07:46 +0000 UTC" firstStartedPulling="2026-06-02 02:07:47.121911393 +0000 UTC m=+676.621455052" lastFinishedPulling="2026-06-02 02:07:49.478951876 +0000 UTC m=+678.978495524" observedRunningTime="2026-06-02 02:07:50.543232835 +0000 UTC m=+680.042776493" watchObservedRunningTime="2026-06-02 02:07:50.54554589 +0000 UTC m=+680.045089556" Jun 02 02:08:01.533196 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:08:01.533161 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-w88qj" Jun 02 02:09:17.393243 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:09:17.393199 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:09:23.788553 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:09:23.788518 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:09:43.287586 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:09:43.287547 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:09:52.202063 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:09:52.201983 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:10:01.241215 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:10:01.241181 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:10:14.694238 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:10:14.694201 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:11:08.781472 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.781433 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5694bd4c8d-szzx8"] Jun 02 02:11:08.784982 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.784959 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.789175 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.789152 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 02:11:08.789341 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.789189 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bssdz\"" Jun 02 02:11:08.789341 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.789164 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 02:11:08.792484 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.792458 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5694bd4c8d-szzx8"] Jun 02 02:11:08.865955 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.865920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-oidc-ca\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.866118 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.865959 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx2sk\" (UniqueName: \"kubernetes.io/projected/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-kube-api-access-wx2sk\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.866118 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.866020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-tls-cert\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.966900 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.966865 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-oidc-ca\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.966900 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.966905 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wx2sk\" (UniqueName: \"kubernetes.io/projected/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-kube-api-access-wx2sk\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.967125 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.967048 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-tls-cert\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.967511 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.967494 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-oidc-ca\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.969463 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.969438 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-tls-cert\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:08.975390 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:08.975369 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx2sk\" (UniqueName: \"kubernetes.io/projected/b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8-kube-api-access-wx2sk\") pod \"authorino-5694bd4c8d-szzx8\" (UID: \"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8\") " pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:09.095162 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:09.095134 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5694bd4c8d-szzx8" Jun 02 02:11:09.231026 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:09.231000 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5694bd4c8d-szzx8"] Jun 02 02:11:09.232976 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:11:09.232938 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9bcc754_0f74_4e5a_bd65_c4dcf96f96b8.slice/crio-7ef0cb51f9fca08f0aafed5849b88ced07cab44b83486692447c52639657975e WatchSource:0}: Error finding container 7ef0cb51f9fca08f0aafed5849b88ced07cab44b83486692447c52639657975e: Status 404 returned error can't find the container with id 7ef0cb51f9fca08f0aafed5849b88ced07cab44b83486692447c52639657975e Jun 02 02:11:09.238373 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:09.238344 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5694bd4c8d-szzx8" event={"ID":"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8","Type":"ContainerStarted","Data":"7ef0cb51f9fca08f0aafed5849b88ced07cab44b83486692447c52639657975e"} Jun 02 02:11:13.258436 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:13.258396 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5694bd4c8d-szzx8" event={"ID":"b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8","Type":"ContainerStarted","Data":"2d29a5ff7d17bcc3e1f99e164a6f3c62c7e8e1683e37ddcab4a38e036987ed5d"} Jun 02 02:11:13.277771 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:13.277720 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5694bd4c8d-szzx8" podStartSLOduration=1.959948611 podStartE2EDuration="5.277704596s" podCreationTimestamp="2026-06-02 02:11:08 +0000 UTC" firstStartedPulling="2026-06-02 02:11:09.234309176 +0000 UTC m=+878.733852825" lastFinishedPulling="2026-06-02 02:11:12.552065005 +0000 UTC m=+882.051608810" observedRunningTime="2026-06-02 02:11:13.275856294 +0000 UTC m=+882.775399961" watchObservedRunningTime="2026-06-02 02:11:13.277704596 +0000 UTC m=+882.777248273" Jun 02 02:11:40.788481 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:40.788398 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:11:50.591136 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:50.591093 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:11:59.692550 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:11:59.692508 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:12:11.289586 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:12:11.289540 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:12:19.890515 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:12:19.890473 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:12:29.286951 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:12:29.286905 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:13:41.486246 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:13:41.486209 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:13:57.288810 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:13:57.288772 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:14:37.597372 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:14:37.597287 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:14:52.990995 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:14:52.990956 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:15:00.144763 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.144723 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29672775-gdz8j"] Jun 02 02:15:00.148393 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.148370 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:00.151482 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.151457 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t7slq\"" Jun 02 02:15:00.162945 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.162921 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29672775-gdz8j"] Jun 02 02:15:00.214479 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.214434 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fw9q\" (UniqueName: \"kubernetes.io/projected/7a3e880e-889f-4446-aa31-6db7e71f8300-kube-api-access-4fw9q\") pod \"maas-api-key-cleanup-29672775-gdz8j\" (UID: \"7a3e880e-889f-4446-aa31-6db7e71f8300\") " pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:00.315596 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.315543 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4fw9q\" (UniqueName: \"kubernetes.io/projected/7a3e880e-889f-4446-aa31-6db7e71f8300-kube-api-access-4fw9q\") pod \"maas-api-key-cleanup-29672775-gdz8j\" (UID: \"7a3e880e-889f-4446-aa31-6db7e71f8300\") " pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:00.325267 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.325230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fw9q\" (UniqueName: \"kubernetes.io/projected/7a3e880e-889f-4446-aa31-6db7e71f8300-kube-api-access-4fw9q\") pod \"maas-api-key-cleanup-29672775-gdz8j\" (UID: \"7a3e880e-889f-4446-aa31-6db7e71f8300\") " pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:00.458896 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.458817 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:00.592034 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.592006 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29672775-gdz8j"] Jun 02 02:15:00.594570 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:15:00.594536 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3e880e_889f_4446_aa31_6db7e71f8300.slice/crio-3cec68ca7f3b392d3c5b76b5146f794de2faf8a2376ef5a34fbe40baf22a1b9b WatchSource:0}: Error finding container 3cec68ca7f3b392d3c5b76b5146f794de2faf8a2376ef5a34fbe40baf22a1b9b: Status 404 returned error can't find the container with id 3cec68ca7f3b392d3c5b76b5146f794de2faf8a2376ef5a34fbe40baf22a1b9b Jun 02 02:15:00.596455 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:00.596435 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:15:01.092877 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:01.092842 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" event={"ID":"7a3e880e-889f-4446-aa31-6db7e71f8300","Type":"ContainerStarted","Data":"3cec68ca7f3b392d3c5b76b5146f794de2faf8a2376ef5a34fbe40baf22a1b9b"} Jun 02 02:15:04.104503 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:04.104468 2579 generic.go:358] "Generic (PLEG): container finished" podID="7a3e880e-889f-4446-aa31-6db7e71f8300" containerID="3ff677c9371db2ce0496ce475edf4bd045bc071bb399e9d21fd136a0c0950250" exitCode=0 Jun 02 02:15:04.104894 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:04.104515 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" event={"ID":"7a3e880e-889f-4446-aa31-6db7e71f8300","Type":"ContainerDied","Data":"3ff677c9371db2ce0496ce475edf4bd045bc071bb399e9d21fd136a0c0950250"} Jun 02 02:15:05.244323 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:05.244294 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:05.359724 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:05.359604 2579 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fw9q\" (UniqueName: \"kubernetes.io/projected/7a3e880e-889f-4446-aa31-6db7e71f8300-kube-api-access-4fw9q\") pod \"7a3e880e-889f-4446-aa31-6db7e71f8300\" (UID: \"7a3e880e-889f-4446-aa31-6db7e71f8300\") " Jun 02 02:15:05.362135 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:05.362106 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a3e880e-889f-4446-aa31-6db7e71f8300-kube-api-access-4fw9q" (OuterVolumeSpecName: "kube-api-access-4fw9q") pod "7a3e880e-889f-4446-aa31-6db7e71f8300" (UID: "7a3e880e-889f-4446-aa31-6db7e71f8300"). InnerVolumeSpecName "kube-api-access-4fw9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:15:05.460852 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:05.460815 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fw9q\" (UniqueName: \"kubernetes.io/projected/7a3e880e-889f-4446-aa31-6db7e71f8300-kube-api-access-4fw9q\") on node \"ip-10-0-131-106.ec2.internal\" DevicePath \"\"" Jun 02 02:15:06.112181 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:06.112146 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" event={"ID":"7a3e880e-889f-4446-aa31-6db7e71f8300","Type":"ContainerDied","Data":"3cec68ca7f3b392d3c5b76b5146f794de2faf8a2376ef5a34fbe40baf22a1b9b"} Jun 02 02:15:06.112181 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:06.112181 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cec68ca7f3b392d3c5b76b5146f794de2faf8a2376ef5a34fbe40baf22a1b9b" Jun 02 02:15:06.112181 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:06.112165 2579 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29672775-gdz8j" Jun 02 02:15:06.986520 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:06.986475 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:15:14.892654 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:14.892617 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:15:23.279791 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:23.279749 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:15:32.486205 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:32.486171 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-cdxdh"] Jun 02 02:15:37.032642 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:37.032603 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5694bd4c8d-szzx8_b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8/authorino/0.log" Jun 02 02:15:41.549858 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:41.549829 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-765cfc44cf-9zpbg_c98bd687-ec68-426c-b720-9a029cbec984/nginx/0.log" Jun 02 02:15:42.129621 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:42.129586 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29672775-gdz8j_7a3e880e-889f-4446-aa31-6db7e71f8300/cleanup/0.log" Jun 02 02:15:42.354013 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:42.353989 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-96dcs_6ee5fe47-0c20-4742-968f-06011dce7c6d/server/0.log" Jun 02 02:15:42.592063 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:42.592038 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-8qlrk_d695516a-ae7e-4be9-b3f4-4f91afed8c5c/copy-manifests/0.log" Jun 02 02:15:42.598702 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:42.598672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-8qlrk_d695516a-ae7e-4be9-b3f4-4f91afed8c5c/manager/0.log" Jun 02 02:15:44.221036 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:44.221004 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5694bd4c8d-szzx8_b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8/authorino/0.log" Jun 02 02:15:44.334674 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:44.334624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-j84tl_30f57cec-4c40-4759-b51f-751c5d17e328/manager/0.log" Jun 02 02:15:44.662841 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:44.662810 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tdk7v_97c01e15-5371-494c-8e7c-f3ba32801c56/registry-server/0.log" Jun 02 02:15:44.886844 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:44.886806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-cdxdh_e35832b7-2df5-492e-8bad-f64cc0471888/limitador/0.log" Jun 02 02:15:45.006939 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:45.006869 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-jbxpd_1bdf54d1-1961-44a6-9578-42e125d48c4e/manager/0.log" Jun 02 02:15:45.345416 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:45.345386 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bgql8h_8c8ce67f-adbf-4e9c-90a1-1962ccc04618/istio-proxy/0.log" Jun 02 02:15:45.913908 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:45.913878 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-w88qj_79be1f60-7fc4-4683-8a15-eedbdd2c6505/payload-processing/0.log" Jun 02 02:15:46.019980 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:46.019956 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54cd7cd9c9-6c8fd_ec5c3545-2340-400b-8f7d-1cf4d42c08fb/router/0.log" Jun 02 02:15:50.557643 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.557560 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cwwm7/must-gather-f9xvv"] Jun 02 02:15:50.558038 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.558023 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a3e880e-889f-4446-aa31-6db7e71f8300" containerName="cleanup" Jun 02 02:15:50.558083 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.558039 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a3e880e-889f-4446-aa31-6db7e71f8300" containerName="cleanup" Jun 02 02:15:50.558132 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.558123 2579 memory_manager.go:356] "RemoveStaleState removing state" podUID="7a3e880e-889f-4446-aa31-6db7e71f8300" containerName="cleanup" Jun 02 02:15:50.562857 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.562837 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.565788 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.565769 2579 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cwwm7\"/\"default-dockercfg-rb8ww\"" Jun 02 02:15:50.565890 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.565807 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cwwm7\"/\"openshift-service-ca.crt\"" Jun 02 02:15:50.565890 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.565881 2579 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cwwm7\"/\"kube-root-ca.crt\"" Jun 02 02:15:50.570579 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.570550 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwwm7/must-gather-f9xvv"] Jun 02 02:15:50.671337 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.671303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfc2\" (UniqueName: \"kubernetes.io/projected/4a5b6298-0ec8-4fc2-8b63-891707cf2824-kube-api-access-crfc2\") pod \"must-gather-f9xvv\" (UID: \"4a5b6298-0ec8-4fc2-8b63-891707cf2824\") " pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.671529 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.671350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a5b6298-0ec8-4fc2-8b63-891707cf2824-must-gather-output\") pod \"must-gather-f9xvv\" (UID: \"4a5b6298-0ec8-4fc2-8b63-891707cf2824\") " pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.772396 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.772359 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crfc2\" (UniqueName: \"kubernetes.io/projected/4a5b6298-0ec8-4fc2-8b63-891707cf2824-kube-api-access-crfc2\") pod \"must-gather-f9xvv\" (UID: \"4a5b6298-0ec8-4fc2-8b63-891707cf2824\") " pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.772562 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.772406 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a5b6298-0ec8-4fc2-8b63-891707cf2824-must-gather-output\") pod \"must-gather-f9xvv\" (UID: \"4a5b6298-0ec8-4fc2-8b63-891707cf2824\") " pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.772744 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.772728 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a5b6298-0ec8-4fc2-8b63-891707cf2824-must-gather-output\") pod \"must-gather-f9xvv\" (UID: \"4a5b6298-0ec8-4fc2-8b63-891707cf2824\") " pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.782515 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.782492 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfc2\" (UniqueName: \"kubernetes.io/projected/4a5b6298-0ec8-4fc2-8b63-891707cf2824-kube-api-access-crfc2\") pod \"must-gather-f9xvv\" (UID: \"4a5b6298-0ec8-4fc2-8b63-891707cf2824\") " pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:50.873245 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:50.873202 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwwm7/must-gather-f9xvv" Jun 02 02:15:51.005158 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:51.005135 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwwm7/must-gather-f9xvv"] Jun 02 02:15:51.006829 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:15:51.006803 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a5b6298_0ec8_4fc2_8b63_891707cf2824.slice/crio-0990e306dd09e67dd594d7b334cea40bc7ff064460912a987a184469d8440db1 WatchSource:0}: Error finding container 0990e306dd09e67dd594d7b334cea40bc7ff064460912a987a184469d8440db1: Status 404 returned error can't find the container with id 0990e306dd09e67dd594d7b334cea40bc7ff064460912a987a184469d8440db1 Jun 02 02:15:51.275480 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:51.275398 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/must-gather-f9xvv" event={"ID":"4a5b6298-0ec8-4fc2-8b63-891707cf2824","Type":"ContainerStarted","Data":"0990e306dd09e67dd594d7b334cea40bc7ff064460912a987a184469d8440db1"} Jun 02 02:15:52.281636 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:52.281603 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/must-gather-f9xvv" event={"ID":"4a5b6298-0ec8-4fc2-8b63-891707cf2824","Type":"ContainerStarted","Data":"6aebeb8e0371007d8e347bbe7006841ed1b03e2c8cadd50a52150ebfa619d611"} Jun 02 02:15:52.281636 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:52.281637 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/must-gather-f9xvv" event={"ID":"4a5b6298-0ec8-4fc2-8b63-891707cf2824","Type":"ContainerStarted","Data":"613903c8caf7f190a7ab413063caa9cd89df3b035b552aebd06c8cbd1fb49183"} Jun 02 02:15:52.300683 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:52.300620 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-cwwm7/must-gather-f9xvv" podStartSLOduration=1.511562719 podStartE2EDuration="2.30060374s" podCreationTimestamp="2026-06-02 02:15:50 +0000 UTC" firstStartedPulling="2026-06-02 02:15:51.00856486 +0000 UTC m=+1160.508108506" lastFinishedPulling="2026-06-02 02:15:51.797605881 +0000 UTC m=+1161.297149527" observedRunningTime="2026-06-02 02:15:52.299088606 +0000 UTC m=+1161.798632270" watchObservedRunningTime="2026-06-02 02:15:52.30060374 +0000 UTC m=+1161.800147408" Jun 02 02:15:53.485623 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:53.485591 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q4dpz_071ad239-b657-4ffb-8054-f9d8cecbac1c/global-pull-secret-syncer/0.log" Jun 02 02:15:53.661211 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:53.661185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qn7sb_586b98f9-bf13-49c5-8566-3e6ca679886d/konnectivity-agent/0.log" Jun 02 02:15:53.710053 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:53.710021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-106.ec2.internal_23004b7e1a83c12f34e3d0929fcfb824/haproxy/0.log" Jun 02 02:15:57.997229 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:57.997190 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5694bd4c8d-szzx8_b9bcc754-0f74-4e5a-bd65-c4dcf96f96b8/authorino/0.log" Jun 02 02:15:58.030713 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:58.030680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-j84tl_30f57cec-4c40-4759-b51f-751c5d17e328/manager/0.log" Jun 02 02:15:58.126744 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:58.126712 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tdk7v_97c01e15-5371-494c-8e7c-f3ba32801c56/registry-server/0.log" Jun 02 02:15:58.204553 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:58.204519 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-cdxdh_e35832b7-2df5-492e-8bad-f64cc0471888/limitador/0.log" Jun 02 02:15:58.248459 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:58.248375 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-jbxpd_1bdf54d1-1961-44a6-9578-42e125d48c4e/manager/0.log" Jun 02 02:15:59.754383 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.754354 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/alertmanager/0.log" Jun 02 02:15:59.778677 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.778627 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/config-reloader/0.log" Jun 02 02:15:59.802760 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.802724 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/kube-rbac-proxy-web/0.log" Jun 02 02:15:59.825341 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.825314 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/kube-rbac-proxy/0.log" Jun 02 02:15:59.856177 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.856144 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/kube-rbac-proxy-metric/0.log" Jun 02 02:15:59.879438 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.879413 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/prom-label-proxy/0.log" Jun 02 02:15:59.906416 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.906341 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6c1c93b2-0c7c-4c06-b36f-f818eb81e212/init-config-reloader/0.log" Jun 02 02:15:59.947518 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:15:59.947490 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-xp764_498a1b29-533d-42bf-be7d-6e277149cec6/cluster-monitoring-operator/0.log" Jun 02 02:16:00.081475 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.081445 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-frtz6_da4d2cd8-328e-4b83-a70f-89223cd3488b/monitoring-plugin/0.log" Jun 02 02:16:00.219726 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.219619 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bfbs9_1e70e50c-7a22-4b26-ab22-2f8dd349105a/node-exporter/0.log" Jun 02 02:16:00.248499 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.248470 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bfbs9_1e70e50c-7a22-4b26-ab22-2f8dd349105a/kube-rbac-proxy/0.log" Jun 02 02:16:00.272372 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.272345 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bfbs9_1e70e50c-7a22-4b26-ab22-2f8dd349105a/init-textfile/0.log" Jun 02 02:16:00.385249 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.385221 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bt4ll_5878929c-a72b-44a0-ad5c-5aaf87d886af/kube-rbac-proxy-main/0.log" Jun 02 02:16:00.415560 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.415530 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bt4ll_5878929c-a72b-44a0-ad5c-5aaf87d886af/kube-rbac-proxy-self/0.log" Jun 02 02:16:00.439031 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.438999 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bt4ll_5878929c-a72b-44a0-ad5c-5aaf87d886af/openshift-state-metrics/0.log" Jun 02 02:16:00.655011 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.654969 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-nwgd8_c9eb4784-1023-478c-b413-20cddd537896/prometheus-operator/0.log" Jun 02 02:16:00.676226 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.676191 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-nwgd8_c9eb4784-1023-478c-b413-20cddd537896/kube-rbac-proxy/0.log" Jun 02 02:16:00.700859 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.700834 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-v4fzf_d9042b37-bc2f-4b01-9ef9-9da1011377f7/prometheus-operator-admission-webhook/0.log" Jun 02 02:16:00.736534 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.736487 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db7c9c56f-2tqrm_7abc06ba-3e44-4e48-85ce-c2b24916075d/telemeter-client/0.log" Jun 02 02:16:00.767185 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.767125 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db7c9c56f-2tqrm_7abc06ba-3e44-4e48-85ce-c2b24916075d/reload/0.log" Jun 02 02:16:00.790117 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:00.790088 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db7c9c56f-2tqrm_7abc06ba-3e44-4e48-85ce-c2b24916075d/kube-rbac-proxy/0.log" Jun 02 02:16:02.709489 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.709449 2579 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh"] Jun 02 02:16:02.716686 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.716637 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.723051 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.723017 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh"] Jun 02 02:16:02.796526 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.796489 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-podres\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.796741 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.796572 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-sys\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.796741 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.796592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-lib-modules\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.796865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.796737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdggs\" (UniqueName: \"kubernetes.io/projected/6bbb87ee-ec35-4148-86b0-409207523b6c-kube-api-access-cdggs\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.796865 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.796780 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-proc\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897696 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897643 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-sys\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897696 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897700 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-lib-modules\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897932 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897764 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdggs\" (UniqueName: \"kubernetes.io/projected/6bbb87ee-ec35-4148-86b0-409207523b6c-kube-api-access-cdggs\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897932 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897793 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-proc\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897932 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897831 2579 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-podres\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897932 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-sys\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897932 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897870 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-lib-modules\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.897932 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897870 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-proc\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.898193 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.897964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bbb87ee-ec35-4148-86b0-409207523b6c-podres\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:02.906597 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:02.906511 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdggs\" (UniqueName: \"kubernetes.io/projected/6bbb87ee-ec35-4148-86b0-409207523b6c-kube-api-access-cdggs\") pod \"perf-node-gather-daemonset-pwfmh\" (UID: \"6bbb87ee-ec35-4148-86b0-409207523b6c\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:03.034553 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:03.032965 2579 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:03.186103 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:03.186064 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-674555986-86f5n_12edba3d-46b2-412d-92ea-608e125f7668/console/0.log" Jun 02 02:16:03.205206 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:03.205178 2579 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh"] Jun 02 02:16:03.207110 ip-10-0-131-106 kubenswrapper[2579]: W0602 02:16:03.207070 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6bbb87ee_ec35_4148_86b0_409207523b6c.slice/crio-3fe4c2c5f13c8d5a10dd3ca76813212af9ad44d18c0f13cdd0a49c1da11f03d9 WatchSource:0}: Error finding container 3fe4c2c5f13c8d5a10dd3ca76813212af9ad44d18c0f13cdd0a49c1da11f03d9: Status 404 returned error can't find the container with id 3fe4c2c5f13c8d5a10dd3ca76813212af9ad44d18c0f13cdd0a49c1da11f03d9 Jun 02 02:16:03.217006 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:03.216974 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-p86kn_d027c761-42a9-46f8-84f1-9bf70b5c508f/download-server/0.log" Jun 02 02:16:03.338517 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:03.338467 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" event={"ID":"6bbb87ee-ec35-4148-86b0-409207523b6c","Type":"ContainerStarted","Data":"3fe4c2c5f13c8d5a10dd3ca76813212af9ad44d18c0f13cdd0a49c1da11f03d9"} Jun 02 02:16:04.344039 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:04.344004 2579 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" event={"ID":"6bbb87ee-ec35-4148-86b0-409207523b6c","Type":"ContainerStarted","Data":"8fd6190fa041131c3b351443a4659a26f9149efb55f3442ca08514d7acada0b2"} Jun 02 02:16:04.344410 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:04.344129 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:04.361235 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:04.361191 2579 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" podStartSLOduration=2.361176446 podStartE2EDuration="2.361176446s" podCreationTimestamp="2026-06-02 02:16:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:16:04.359553793 +0000 UTC m=+1173.859097462" watchObservedRunningTime="2026-06-02 02:16:04.361176446 +0000 UTC m=+1173.860720114" Jun 02 02:16:04.591857 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:04.591823 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fmr8x_00f37939-1151-4303-ad65-604b2fd38d25/dns/0.log" Jun 02 02:16:04.615146 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:04.615073 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fmr8x_00f37939-1151-4303-ad65-604b2fd38d25/kube-rbac-proxy/0.log" Jun 02 02:16:04.777611 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:04.777585 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tgzrg_9e03de92-1707-4347-9a1a-a8f9d499f853/dns-node-resolver/0.log" Jun 02 02:16:05.428679 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:05.428647 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qs9z2_7bc0ef35-081a-4873-9207-121947a1ce06/node-ca/0.log" Jun 02 02:16:06.273440 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:06.273415 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bgql8h_8c8ce67f-adbf-4e9c-90a1-1962ccc04618/istio-proxy/0.log" Jun 02 02:16:06.446009 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:06.445979 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-w88qj_79be1f60-7fc4-4683-8a15-eedbdd2c6505/payload-processing/0.log" Jun 02 02:16:06.465885 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:06.465861 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54cd7cd9c9-6c8fd_ec5c3545-2340-400b-8f7d-1cf4d42c08fb/router/0.log" Jun 02 02:16:07.081855 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:07.081818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-flrpl_354a6bea-a69e-4422-b6d2-78d2419bdcc1/serve-healthcheck-canary/0.log" Jun 02 02:16:07.581982 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:07.581948 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-dkxp2_7e198b4a-906c-4558-bbf6-e00831ad8d00/insights-operator/0.log" Jun 02 02:16:07.582386 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:07.581998 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-dkxp2_7e198b4a-906c-4558-bbf6-e00831ad8d00/insights-operator/1.log" Jun 02 02:16:07.693094 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:07.693059 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szkfk_ceccd35a-705d-4032-8f98-dc11f5d50f50/kube-rbac-proxy/0.log" Jun 02 02:16:07.715909 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:07.715879 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szkfk_ceccd35a-705d-4032-8f98-dc11f5d50f50/exporter/0.log" Jun 02 02:16:07.738460 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:07.738439 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szkfk_ceccd35a-705d-4032-8f98-dc11f5d50f50/extractor/0.log" Jun 02 02:16:09.760978 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:09.760950 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-765cfc44cf-9zpbg_c98bd687-ec68-426c-b720-9a029cbec984/nginx/0.log" Jun 02 02:16:09.908011 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:09.907985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29672775-gdz8j_7a3e880e-889f-4446-aa31-6db7e71f8300/cleanup/0.log" Jun 02 02:16:09.957902 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:09.957880 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-96dcs_6ee5fe47-0c20-4742-968f-06011dce7c6d/server/0.log" Jun 02 02:16:10.027472 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:10.027404 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-8qlrk_d695516a-ae7e-4be9-b3f4-4f91afed8c5c/manager/0.log" Jun 02 02:16:10.051682 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:10.051634 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-8qlrk_d695516a-ae7e-4be9-b3f4-4f91afed8c5c/copy-manifests/0.log" Jun 02 02:16:10.359328 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:10.359294 2579 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-pwfmh" Jun 02 02:16:11.750087 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:11.750006 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fbdf7846d-ppgn9_16e5b840-a772-46d6-8115-9b626e4604c7/manager/0.log" Jun 02 02:16:16.676925 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:16.676893 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-prjs6_34900e52-b119-480c-a54e-6055d2b5b081/migrator/0.log" Jun 02 02:16:16.698363 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:16.698336 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-prjs6_34900e52-b119-480c-a54e-6055d2b5b081/graceful-termination/0.log" Jun 02 02:16:17.091231 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:17.091181 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-sx5lb_3d630ea1-2147-4486-8a39-8eaa45ffe09c/kube-storage-version-migrator-operator/1.log" Jun 02 02:16:17.092002 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:17.091972 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-sx5lb_3d630ea1-2147-4486-8a39-8eaa45ffe09c/kube-storage-version-migrator-operator/0.log" Jun 02 02:16:18.310910 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.310881 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/kube-multus-additional-cni-plugins/0.log" Jun 02 02:16:18.334165 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.334131 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/egress-router-binary-copy/0.log" Jun 02 02:16:18.358082 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.358060 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/cni-plugins/0.log" Jun 02 02:16:18.381189 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.381161 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/bond-cni-plugin/0.log" Jun 02 02:16:18.401779 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.401753 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/routeoverride-cni/0.log" Jun 02 02:16:18.423755 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.423732 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/whereabouts-cni-bincopy/0.log" Jun 02 02:16:18.444923 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.444894 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpbkk_af737d9f-0a48-4ee9-a9f7-ab8de6177a6e/whereabouts-cni/0.log" Jun 02 02:16:18.643544 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.643406 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q77rp_9c290ded-4e9c-4bed-9174-4b62bd3ed78f/kube-multus/0.log" Jun 02 02:16:18.740874 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.740847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkmb5_8279cd15-4d48-4db4-9f0a-6f96b3a21c2d/network-metrics-daemon/0.log" Jun 02 02:16:18.761377 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:18.761352 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gkmb5_8279cd15-4d48-4db4-9f0a-6f96b3a21c2d/kube-rbac-proxy/0.log" Jun 02 02:16:19.950810 ip-10-0-131-106 kubenswrapper[2579]: I0602 02:16:19.950782 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mbdtj_e1d91dba-ad25-46be-9e87-06b814da1abf/ovn-controller/0.log"