Jun 02 21:41:20.490451 ip-10-0-141-177 systemd[1]: Starting Kubernetes Kubelet... Jun 02 21:41:20.902274 ip-10-0-141-177 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:41:20.902274 ip-10-0-141-177 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 21:41:20.902274 ip-10-0-141-177 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:41:20.902274 ip-10-0-141-177 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 21:41:20.902274 ip-10-0-141-177 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 21:41:20.903074 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.902991 2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 21:41:20.905789 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905773 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:20.905789 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905789 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905793 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905797 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905800 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905803 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905806 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905809 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905812 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905815 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905817 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905820 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905823 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905826 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905829 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905831 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905833 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905836 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905839 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905841 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905844 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:20.905862 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905847 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905850 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905852 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905862 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905865 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905868 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905871 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905875 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905878 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905880 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905883 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905886 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905889 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905892 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905894 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905897 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905900 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905903 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905906 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:20.906360 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905908 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905911 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905913 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905916 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905919 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905921 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905924 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905926 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905929 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905933 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905936 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905939 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905941 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905944 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905946 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905950 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905973 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905977 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905980 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905984 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:20.906833 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905987 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905989 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905993 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.905998 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906001 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906005 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906008 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906010 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906013 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906016 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906019 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906021 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906024 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906027 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906029 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906032 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906035 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906037 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906040 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:20.907356 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906042 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906045 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906047 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906050 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906052 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906055 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906057 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906463 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906470 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906472 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906475 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906478 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906481 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906483 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906486 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906489 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906492 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906494 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906497 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906499 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:20.907822 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906502 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906504 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906507 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906510 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906512 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906515 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906517 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906520 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906523 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906525 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906528 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906530 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906533 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906535 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906539 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906543 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906546 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906549 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906552 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906554 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:20.908319 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906557 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906560 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906563 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906565 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906567 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906570 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906572 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906575 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906577 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906580 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906582 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906585 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906587 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906591 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906595 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906598 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906601 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906603 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906606 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:20.908823 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906609 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906611 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906614 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906617 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906619 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906622 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906624 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906626 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906629 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906633 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906635 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906638 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906640 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906644 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906647 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906649 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906652 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906654 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906657 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906659 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:20.909315 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906662 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906664 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906666 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906669 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906671 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906674 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906676 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906678 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906681 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906683 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906686 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906688 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906691 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.906693 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906763 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906771 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906777 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906784 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906790 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906795 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906801 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 21:41:20.909800 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906809 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906812 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906816 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906819 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906823 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906826 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906829 2565 flags.go:64] FLAG: --cgroup-root="" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906832 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906835 2565 flags.go:64] FLAG: --client-ca-file="" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906839 2565 flags.go:64] FLAG: --cloud-config="" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906842 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906845 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906851 2565 flags.go:64] FLAG: --cluster-domain="" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906854 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906857 2565 flags.go:64] FLAG: --config-dir="" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906860 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906863 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906867 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906870 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906873 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906876 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906879 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906882 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906885 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906888 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 21:41:20.910331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906891 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906895 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906900 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906903 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906907 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906910 2565 flags.go:64] FLAG: --enable-server="true" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906913 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906917 2565 flags.go:64] FLAG: --event-burst="100" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906920 2565 flags.go:64] FLAG: --event-qps="50" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906923 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906927 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906930 2565 flags.go:64] FLAG: --eviction-hard="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906934 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906937 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906940 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906943 2565 flags.go:64] FLAG: --eviction-soft="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906946 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906949 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906952 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906955 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906958 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906961 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906964 2565 flags.go:64] FLAG: --feature-gates="" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906968 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906970 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 21:41:20.910958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906973 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906977 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906980 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906983 2565 flags.go:64] FLAG: --help="false" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906986 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-141-177.ec2.internal" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906989 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906991 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906995 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.906998 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907001 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907005 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907012 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907015 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907018 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907021 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907024 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907027 2565 flags.go:64] FLAG: --kube-reserved="" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907030 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907033 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907036 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907040 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907043 2565 flags.go:64] FLAG: --lock-file="" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907046 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907049 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 21:41:20.911598 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907052 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907056 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907059 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907063 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907066 2565 flags.go:64] FLAG: --logging-format="text" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907069 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907072 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907074 2565 flags.go:64] FLAG: --manifest-url="" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907077 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907082 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907085 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907090 2565 flags.go:64] FLAG: --max-pods="110" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907093 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907095 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907098 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907101 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907106 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907109 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907112 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907121 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907124 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907127 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907130 2565 flags.go:64] FLAG: --pod-cidr="" Jun 02 21:41:20.912301 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907133 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907138 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907141 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907144 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907147 2565 flags.go:64] FLAG: --port="10250" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907150 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907153 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05c6a5d835a827ffe" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907156 2565 flags.go:64] FLAG: --qos-reserved="" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907173 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907177 2565 flags.go:64] FLAG: --register-node="true" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907180 2565 flags.go:64] FLAG: --register-schedulable="true" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907183 2565 flags.go:64] FLAG: --register-with-taints="" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907187 2565 flags.go:64] FLAG: --registry-burst="10" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907190 2565 flags.go:64] FLAG: --registry-qps="5" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907193 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907196 2565 flags.go:64] FLAG: --reserved-memory="" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907200 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907203 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907206 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907209 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907212 2565 flags.go:64] FLAG: --runonce="false" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907215 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907218 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907221 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907224 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907228 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 21:41:20.912877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907232 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907236 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907239 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907244 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907247 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907250 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907253 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907255 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907258 2565 flags.go:64] FLAG: --system-cgroups="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907261 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907267 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907269 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907272 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907277 2565 flags.go:64] FLAG: --tls-min-version="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907280 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907282 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907285 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907288 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907291 2565 flags.go:64] FLAG: --v="2" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907295 2565 flags.go:64] FLAG: --version="false" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907300 2565 flags.go:64] FLAG: --vmodule="" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907304 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.907307 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907402 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:20.913620 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907406 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907409 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907412 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907415 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907419 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907422 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907425 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907437 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907440 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907443 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907445 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907449 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907452 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907455 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907458 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907460 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907463 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907466 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907468 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:20.914650 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907471 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907474 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907476 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907479 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907481 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907484 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907486 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907489 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907491 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907494 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907497 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907499 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907501 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907504 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907506 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907509 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907512 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907514 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907517 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907519 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:20.915512 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907523 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907526 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907529 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907531 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907535 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907537 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907540 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907543 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907545 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907548 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907550 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907553 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907556 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907559 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907561 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907564 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907567 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907570 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907572 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907575 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:20.916418 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907577 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907580 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907583 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907585 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907588 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907590 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907593 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907595 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907598 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907600 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907603 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907605 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907610 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907612 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907614 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907617 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907622 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907624 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907627 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907630 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:20.917091 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907633 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907636 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907639 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907642 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907645 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.907647 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.908272 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.915544 2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.915563 2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915635 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915643 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915648 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915653 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915658 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915662 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:20.917769 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915666 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915670 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915676 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915680 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915685 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915689 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915693 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915697 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915701 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915705 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915710 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915714 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915718 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915722 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915726 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915730 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915736 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915740 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915744 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915749 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:20.918251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915753 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915757 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915761 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915765 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915771 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915778 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915783 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915787 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915791 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915795 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915800 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915804 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915809 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915813 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915818 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915821 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915826 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915830 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915834 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915838 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:20.918905 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915842 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915846 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915850 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915855 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915859 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915863 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915881 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915886 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915890 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915896 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915900 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915904 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915908 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915912 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915917 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915920 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915925 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915930 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915934 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:20.919437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915940 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915944 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915948 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915952 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915956 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915964 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915970 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915975 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915980 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915985 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915989 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915994 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.915998 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916003 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916006 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916010 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916015 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916019 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916023 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:20.920251 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916028 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916032 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.916042 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916209 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916219 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916224 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916228 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916233 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916237 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916241 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916244 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916249 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916254 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916258 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916262 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916267 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 21:41:20.920829 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916271 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916275 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916280 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916284 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916288 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916292 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916296 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916301 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916305 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916309 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916313 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916317 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916321 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916326 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916331 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916335 2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916339 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916343 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916348 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 21:41:20.921464 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916355 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916361 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916366 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916371 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916375 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916379 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916384 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916388 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916392 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916396 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916400 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916405 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916409 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916413 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916417 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916421 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916425 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916429 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916433 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916436 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 21:41:20.921958 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916440 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916444 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916448 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916452 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916457 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916462 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916466 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916470 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916475 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916479 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916483 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916488 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916493 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916499 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916504 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916509 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916513 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916517 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916521 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916525 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 21:41:20.922529 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916529 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916533 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916537 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916541 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916545 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916550 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916554 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916558 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916562 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916567 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916571 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916575 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916579 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:20.916583 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.916590 2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 21:41:20.923048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.917404 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 21:41:20.923450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.921184 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 21:41:20.923450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.922145 2565 server.go:1019] "Starting client certificate rotation" Jun 02 21:41:20.923450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.922270 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:41:20.923450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.922312 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 21:41:20.943834 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.943809 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:41:20.945642 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.945619 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 21:41:20.959492 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.959473 2565 log.go:25] "Validated CRI v1 runtime API" Jun 02 21:41:20.965173 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.965147 2565 log.go:25] "Validated CRI v1 image API" Jun 02 21:41:20.966513 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.966495 2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 21:41:20.971444 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.971411 2565 fs.go:135] Filesystem UUIDs: map[5992c254-ed50-45df-9645-a8c431cca280:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d3dd47c5-7f4a-4e1d-beac-d1db4c570128:/dev/nvme0n1p3] Jun 02 21:41:20.971519 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.971442 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 21:41:20.975729 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.975616 2565 manager.go:217] Machine: {Timestamp:2026-06-02 21:41:20.975118146 +0000 UTC m=+0.373848993 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100319 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a82fbbc6f8b08500762be4e2ec2d8 SystemUUID:ec2a82fb-bc6f-8b08-5007-62be4e2ec2d8 BootID:76a8ab9c-4ca4-4bfa-973e-210f76cdcacd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7c:a9:08:32:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7c:a9:08:32:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:86:e9:f2:70:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 21:41:20.976205 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.976194 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 21:41:20.976316 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.976304 2565 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 21:41:20.976573 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.976559 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:41:20.978209 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.978180 2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 21:41:20.978356 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.978213 2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 21:41:20.978400 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.978366 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 21:41:20.978400 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.978374 2565 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 21:41:20.978400 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.978381 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:41:20.978961 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.978951 2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 21:41:20.981477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.981466 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:41:20.981589 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.981580 2565 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 21:41:20.983645 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.983635 2565 kubelet.go:491] "Attempting to sync node with API server" Jun 02 21:41:20.983683 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.983654 2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 21:41:20.983683 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.983665 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 21:41:20.983683 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.983675 2565 kubelet.go:397] "Adding apiserver pod source" Jun 02 21:41:20.983683 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.983684 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 21:41:20.984703 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.984691 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:41:20.984747 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.984709 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 21:41:20.987528 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.987513 2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 21:41:20.989555 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.989542 2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 21:41:20.992221 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992209 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992226 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992232 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992238 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992248 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992258 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992266 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 21:41:20.992271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992272 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 21:41:20.992441 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992279 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 21:41:20.992441 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992285 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 21:41:20.992441 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992293 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 21:41:20.992441 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.992299 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 21:41:20.993080 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.993072 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 21:41:20.993110 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.993103 2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 21:41:20.995234 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.995217 2565 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 21:41:20.995947 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:20.995927 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 21:41:20.995990 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:20.995927 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 21:41:20.997406 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.997385 2565 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 21:41:20.997493 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.997450 2565 server.go:1295] "Started kubelet" Jun 02 21:41:20.997917 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.997883 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 21:41:20.997988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.997930 2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 21:41:20.998038 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.998001 2565 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 21:41:20.998209 ip-10-0-141-177 systemd[1]: Started Kubernetes Kubelet. Jun 02 21:41:20.999593 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:20.999575 2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 21:41:21.001004 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.000990 2565 server.go:317] "Adding debug handlers to kubelet server" Jun 02 21:41:21.006791 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.006640 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 21:41:21.006791 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.006657 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 21:41:21.006927 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.006834 2565 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 21:41:21.006927 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.006846 2565 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 21:41:21.007013 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.006959 2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 21:41:21.007059 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007027 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 02 21:41:21.007059 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007036 2565 reconciler.go:26] "Reconciler: start to sync state" Jun 02 21:41:21.007485 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007466 2565 factory.go:55] Registering systemd factory Jun 02 21:41:21.007583 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007520 2565 factory.go:223] Registration of the systemd container factory successfully Jun 02 21:41:21.007583 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.007572 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.007791 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007774 2565 factory.go:153] Registering CRI-O factory Jun 02 21:41:21.007862 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007794 2565 factory.go:223] Registration of the crio container factory successfully Jun 02 21:41:21.007897 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007881 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 21:41:21.007939 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007904 2565 factory.go:103] Registering Raw factory Jun 02 21:41:21.007939 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.007925 2565 manager.go:1196] Started watching for new ooms in manager Jun 02 21:41:21.008334 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.008318 2565 manager.go:319] Starting recovery of all containers Jun 02 21:41:21.010229 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.010207 2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 21:41:21.014887 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.014860 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cqt52" Jun 02 21:41:21.015792 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.015768 2565 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 21:41:21.015902 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.015884 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 21:41:21.016639 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.015786 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18b5618bdaff2b58 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-06-02 21:41:20.99740348 +0000 UTC m=+0.396134327,LastTimestamp:2026-06-02 21:41:20.99740348 +0000 UTC m=+0.396134327,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}" Jun 02 21:41:21.019062 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.019048 2565 manager.go:324] Recovery completed Jun 02 21:41:21.022213 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.022197 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cqt52" Jun 02 21:41:21.023634 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.023619 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:21.025386 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.025370 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:21.025460 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.025399 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:21.025460 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.025419 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:21.025870 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.025850 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 21:41:21.025870 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.025861 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 21:41:21.025977 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.025876 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 02 21:41:21.028326 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.028152 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18b5618bdcaa2746 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-177.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-06-02 21:41:21.02538631 +0000 UTC m=+0.424117159,LastTimestamp:2026-06-02 21:41:21.02538631 +0000 UTC m=+0.424117159,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}" Jun 02 21:41:21.028601 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.028582 2565 policy_none.go:49] "None policy: Start" Jun 02 21:41:21.028670 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.028609 2565 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 21:41:21.028670 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.028663 2565 state_mem.go:35] "Initializing new in-memory state store" Jun 02 21:41:21.074328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074316 2565 manager.go:341] "Starting Device Plugin manager" Jun 02 21:41:21.074419 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.074367 2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 21:41:21.074419 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074379 2565 server.go:85] "Starting device plugin registration server" Jun 02 21:41:21.074593 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074582 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 21:41:21.074659 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074593 2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 21:41:21.074714 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074691 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 21:41:21.074805 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074793 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 21:41:21.074805 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.074804 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 21:41:21.075221 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.075204 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 21:41:21.075293 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.075242 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.101758 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.101732 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 21:41:21.102961 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.102936 2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 21:41:21.103051 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.102966 2565 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 21:41:21.103051 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.102983 2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 21:41:21.103051 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.102989 2565 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 21:41:21.103051 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.103026 2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 21:41:21.104982 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.104963 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:21.174947 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.174862 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:21.176084 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.176067 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:21.176212 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.176098 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:21.176212 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.176109 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:21.176212 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.176133 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.184067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.184048 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.184187 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.184076 2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-177.ec2.internal\": node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.203589 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.203560 2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"] Jun 02 21:41:21.203690 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.203639 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:21.204535 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.204520 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:21.204637 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.204545 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:21.204637 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.204555 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:21.205744 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.205722 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:21.205874 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.205860 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.205916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.205897 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:21.206867 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.206852 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.207066 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207046 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:21.207149 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207078 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:21.207149 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207058 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:21.207149 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207112 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:21.207149 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207089 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:21.207149 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207127 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:21.207862 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207844 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00ab6e9e70b3869b45a8dbd4d89dd58d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"00ab6e9e70b3869b45a8dbd4d89dd58d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.207901 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207876 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.207940 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.207906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.208328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.208304 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.208416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.208332 2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 21:41:21.209405 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.209390 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 21:41:21.209471 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.209410 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 21:41:21.209471 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.209420 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 21:41:21.233826 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.233800 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.238300 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.238285 2565 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.307492 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.307460 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.308591 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.308572 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00ab6e9e70b3869b45a8dbd4d89dd58d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"00ab6e9e70b3869b45a8dbd4d89dd58d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.308655 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.308600 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.308655 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.308619 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.308655 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.308644 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.308780 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.308672 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00ab6e9e70b3869b45a8dbd4d89dd58d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"00ab6e9e70b3869b45a8dbd4d89dd58d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.308780 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.308674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.407793 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.407758 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.508401 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.508380 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.536677 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.536647 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.542565 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.542538 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.608734 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.608693 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.709095 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:21.709067 2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 21:41:21.804662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.804587 2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:21.807487 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.807469 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.817731 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.817709 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:41:21.819344 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.819332 2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 21:41:21.830460 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.830442 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 21:41:21.922179 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.922126 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 21:41:21.922870 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.922279 2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 21:41:21.984052 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.984023 2565 apiserver.go:52] "Watching apiserver" Jun 02 21:41:21.993427 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.993401 2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 21:41:21.995044 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.995020 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dr9pl","openshift-image-registry/node-ca-mcvs8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","openshift-multus/multus-qvnbh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd","openshift-multus/multus-additional-cni-plugins-28tvp","openshift-multus/network-metrics-daemon-ss85j","openshift-network-diagnostics/network-check-target-lcfdg","openshift-network-operator/iptables-alerter-nbgmm","openshift-ovn-kubernetes/ovnkube-node-zg8vk","kube-system/global-pull-secret-syncer-s8lgz","kube-system/konnectivity-agent-6zsmw","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-czqtp"] Jun 02 21:41:21.997248 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.997225 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:21.998208 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.998185 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:21.999156 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.999134 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qvnbh" Jun 02 21:41:21.999324 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.999231 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:21.999382 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.999364 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 21:41:21.999441 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.999412 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 21:41:21.999623 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.999609 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nl5jm\"" Jun 02 21:41:21.999967 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:21.999947 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 21:41:22.000089 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.000073 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 21:41:22.000232 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.000215 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qzhx8\"" Jun 02 21:41:22.000308 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.000251 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 21:41:22.000513 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.000497 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.000779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.000766 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 21:41:22.001261 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.001245 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 21:41:22.001545 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.001530 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t85c4\"" Jun 02 21:41:22.001743 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.001729 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 21:41:22.001916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.001903 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 21:41:22.002073 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.002060 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 21:41:22.002310 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.002296 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 21:41:22.002767 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.002751 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qmpcz\"" Jun 02 21:41:22.006255 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006233 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 21:41:22.006388 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006281 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.006456 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:22.006527 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.006497 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:22.006649 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006534 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 21:41:22.006649 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006628 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 21:41:22.006967 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006940 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 21:41:22.006967 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.006959 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4z2np\"" Jun 02 21:41:22.008027 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.007897 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.008027 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.007983 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:22.008027 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.007900 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.008244 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.007994 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.008244 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.008220 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:22.008481 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.008460 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 21:41:22.008677 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.008661 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 21:41:22.008772 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.008751 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 21:41:22.008865 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.008826 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hw8tx\"" Jun 02 21:41:22.009535 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.009515 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.011312 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.010291 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 21:41:22.011312 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.010324 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 21:41:22.011312 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.009431 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 21:41:22.011312 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.011046 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:41:22.011312 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.011124 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-txjx4\"" Jun 02 21:41:22.011569 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.011405 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 21:41:22.012693 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.012677 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.014453 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.014235 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sqp44\"" Jun 02 21:41:22.023107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023058 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 21:41:22.023212 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023106 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.023286 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-cni-multus\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.023345 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-daemon-config\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.023399 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-tuning-conf-dir\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.023456 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:22.023456 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-cnibin\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.023547 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-log-socket\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.023547 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023487 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-conf-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.023547 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023496 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 21:41:22.023547 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-device-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.023732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023566 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a62f4372-edb5-4df4-aca5-7a17c9178640-host-slash\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.023732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-967gz\" (UniqueName: \"kubernetes.io/projected/a62f4372-edb5-4df4-aca5-7a17c9178640-kube-api-access-967gz\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.023732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023621 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04f83630-51e2-45e2-bc2b-e41ee082f0df-dbus\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.023868 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-multus-certs\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.023868 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-socket-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.023958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.023958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.023930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-systemd-units\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.024052 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024013 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:41:22.024257 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-node-log\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.024713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-hosts-file\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.024713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-os-release\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.024713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024102 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ppv42\"" Jun 02 21:41:22.024713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024603 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 21:41:22.024713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-run-netns\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.024713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024618 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 21:36:21 +0000 UTC" deadline="2028-02-05 22:56:08.850097239 +0000 UTC" Jun 02 21:41:22.025002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024707 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14713h14m46.825407621s" Jun 02 21:41:22.025002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-ovnkube-script-lib\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.025002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024747 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 21:41:22.025002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024796 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a62f4372-edb5-4df4-aca5-7a17c9178640-iptables-alerter-script\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.025002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-system-cni-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.025002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024927 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.025652 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.024955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-cnibin\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.025652 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.025615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9pfv\" (UniqueName: \"kubernetes.io/projected/119157d2-7837-4563-9a73-ef1e3f214237-kube-api-access-k9pfv\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.025790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.025671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/399c7d20-a955-436c-87b2-4af3a3e54323-ovn-node-metrics-cert\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.025790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.025750 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-etc-kubernetes\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.025790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.025781 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9vtb\" (UniqueName: \"kubernetes.io/projected/e8c827a3-ec23-46fc-b489-e29235cdcc12-kube-api-access-p9vtb\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.025930 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.025821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-var-lib-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.025930 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.025881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026100 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026081 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-cni-bin\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026183 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-tmp-dir\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.026289 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-host\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.026386 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-slash\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026386 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-ovnkube-config\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026485 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-env-overrides\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026485 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026418 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88ssn\" (UniqueName: \"kubernetes.io/projected/399c7d20-a955-436c-87b2-4af3a3e54323-kube-api-access-88ssn\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026485 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z85n\" (UniqueName: \"kubernetes.io/projected/32df7e35-cd92-413d-8b1d-7e671a424340-kube-api-access-5z85n\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.026615 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026515 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04f83630-51e2-45e2-bc2b-e41ee082f0df-kubelet-config\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.026660 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-serviceca\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.026713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-run-ovn-kubernetes\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.026757 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-netns\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.026795 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-cni-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.026881 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c827a3-ec23-46fc-b489-e29235cdcc12-cni-binary-copy\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.026930 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026913 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzhzh\" (UniqueName: \"kubernetes.io/projected/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-kube-api-access-zzhzh\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.026981 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9ggq\" (UniqueName: \"kubernetes.io/projected/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-kube-api-access-h9ggq\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.027023 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.026990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-system-cni-dir\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.027098 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-k8s-cni-cncf-io\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.027149 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-kubelet\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.027241 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-kubelet\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.027285 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-cni-netd\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.027316 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027272 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.027316 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-registration-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.027381 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-os-release\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.027381 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.027489 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027399 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-ovn\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.027489 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-socket-dir-parent\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.027580 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-hostroot\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.027628 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9vz\" (UniqueName: \"kubernetes.io/projected/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-kube-api-access-jd9vz\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.027680 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-systemd\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.027726 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027678 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-cni-bin\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.027726 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.027880 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.027725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-sys-fs\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.028256 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.028237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-cni-binary-copy\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.028402 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.028343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.028475 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.028411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-etc-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.029848 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.029830 2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 21:41:22.039144 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.039128 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8p8s" Jun 02 21:41:22.048251 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.048228 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p8p8s" Jun 02 21:41:22.092377 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.092343 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ab6e9e70b3869b45a8dbd4d89dd58d.slice/crio-4b6d0cebfddbe34b4f2aef15a62644d55c94e6c2dd0e9ce3cbcc42d3fe0fe2e2 WatchSource:0}: Error finding container 4b6d0cebfddbe34b4f2aef15a62644d55c94e6c2dd0e9ce3cbcc42d3fe0fe2e2: Status 404 returned error can't find the container with id 4b6d0cebfddbe34b4f2aef15a62644d55c94e6c2dd0e9ce3cbcc42d3fe0fe2e2 Jun 02 21:41:22.092657 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.092639 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4669e9fdc58fcc49647e48b529e468a8.slice/crio-0a06102d0f4de3b6940804c7c210dafc0bcdf0568dca9600e202bf74960415fc WatchSource:0}: Error finding container 0a06102d0f4de3b6940804c7c210dafc0bcdf0568dca9600e202bf74960415fc: Status 404 returned error can't find the container with id 0a06102d0f4de3b6940804c7c210dafc0bcdf0568dca9600e202bf74960415fc Jun 02 21:41:22.096489 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.096450 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:41:22.105665 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.105620 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"00ab6e9e70b3869b45a8dbd4d89dd58d","Type":"ContainerStarted","Data":"4b6d0cebfddbe34b4f2aef15a62644d55c94e6c2dd0e9ce3cbcc42d3fe0fe2e2"} Jun 02 21:41:22.106620 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.106595 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"4669e9fdc58fcc49647e48b529e468a8","Type":"ContainerStarted","Data":"0a06102d0f4de3b6940804c7c210dafc0bcdf0568dca9600e202bf74960415fc"} Jun 02 21:41:22.107622 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.107605 2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 21:41:22.129071 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129045 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzhzh\" (UniqueName: \"kubernetes.io/projected/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-kube-api-access-zzhzh\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.129196 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129086 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h9ggq\" (UniqueName: \"kubernetes.io/projected/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-kube-api-access-h9ggq\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.129196 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129112 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-system-cni-dir\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.129196 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsknb\" (UniqueName: \"kubernetes.io/projected/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-kube-api-access-wsknb\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.129196 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129148 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-k8s-cni-cncf-io\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.129196 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129182 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-kubelet\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129203 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-kubelet\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-system-cni-dir\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129269 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-kubelet\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129274 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-cni-netd\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-kubelet\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129310 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129337 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-registration-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129311 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-cni-netd\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129369 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-os-release\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129378 2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129393 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129403 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-k8s-cni-cncf-io\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.129435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129416 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-ovn\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-var-lib-kubelet\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129460 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-ovn\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129478 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-socket-dir-parent\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129412 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-registration-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129468 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-os-release\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129502 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-hostroot\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129538 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9vz\" (UniqueName: \"kubernetes.io/projected/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-kube-api-access-jd9vz\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129546 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-socket-dir-parent\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-systemd\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129550 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-hostroot\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34339983-2b0c-4d12-98e3-adee17a94e20-konnectivity-ca\") pod \"konnectivity-agent-6zsmw\" (UID: \"34339983-2b0c-4d12-98e3-adee17a94e20\") " pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129614 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-systemd\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129625 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-cni-bin\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129652 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129674 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-cni-bin\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-sys-fs\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.130061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129704 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-cni-binary-copy\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-systemd\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129756 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-lib-modules\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129765 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-sys-fs\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129781 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129821 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-etc-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.129885 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.129929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysconfig\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.129963 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:41:22.629941819 +0000 UTC m=+2.028672668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130000 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-etc-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130003 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-host\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130075 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130102 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-cni-multus\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130128 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-daemon-config\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130153 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-tuning-conf-dir\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.130844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-var-lib-cni-multus\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-run\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.130197 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130221 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130246 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-cnibin\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-cni-binary-copy\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.130258 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:22.630242602 +0000 UTC m=+2.028973442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130287 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-log-socket\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130304 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-cnibin\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34339983-2b0c-4d12-98e3-adee17a94e20-agent-certs\") pod \"konnectivity-agent-6zsmw\" (UID: \"34339983-2b0c-4d12-98e3-adee17a94e20\") " pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-log-socket\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130348 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysctl-conf\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130348 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-tuning-conf-dir\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-sys\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130405 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-conf-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130435 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-device-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-modprobe-d\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.131662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-conf-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130485 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-device-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130491 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a62f4372-edb5-4df4-aca5-7a17c9178640-host-slash\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130518 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-967gz\" (UniqueName: \"kubernetes.io/projected/a62f4372-edb5-4df4-aca5-7a17c9178640-kube-api-access-967gz\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130542 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04f83630-51e2-45e2-bc2b-e41ee082f0df-dbus\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130568 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-multus-certs\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130576 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a62f4372-edb5-4df4-aca5-7a17c9178640-host-slash\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130591 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-socket-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-multus-certs\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130617 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130652 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-systemd-units\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/04f83630-51e2-45e2-bc2b-e41ee082f0df-dbus\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130677 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-node-log\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130699 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-systemd-units\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130719 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-hosts-file\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130728 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-socket-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130744 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-os-release\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.132328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130746 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-node-log\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130760 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-run-netns\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130762 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-hosts-file\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130780 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-ovnkube-script-lib\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysctl-d\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-run-netns\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130814 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-os-release\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-tuned\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130855 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a62f4372-edb5-4df4-aca5-7a17c9178640-iptables-alerter-script\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130872 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-system-cni-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130889 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130924 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-cnibin\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130933 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130944 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9pfv\" (UniqueName: \"kubernetes.io/projected/119157d2-7837-4563-9a73-ef1e3f214237-kube-api-access-k9pfv\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130964 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/399c7d20-a955-436c-87b2-4af3a3e54323-ovn-node-metrics-cert\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.130986 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-etc-kubernetes\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131006 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/119157d2-7837-4563-9a73-ef1e3f214237-cnibin\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.133068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131012 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9vtb\" (UniqueName: \"kubernetes.io/projected/e8c827a3-ec23-46fc-b489-e29235cdcc12-kube-api-access-p9vtb\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131039 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-var-lib-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-etc-kubernetes\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131065 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131084 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/119157d2-7837-4563-9a73-ef1e3f214237-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131091 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-cni-bin\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131117 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-tmp-dir\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-var-lib-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131140 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-host\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131148 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-run-openvswitch\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131197 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-cni-bin\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131202 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-slash\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131226 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-host\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-slash\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131251 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-daemon-config\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131238 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-ovnkube-config\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131266 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-ovnkube-script-lib\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131286 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-env-overrides\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.133816 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131307 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-system-cni-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131283 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131315 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88ssn\" (UniqueName: \"kubernetes.io/projected/399c7d20-a955-436c-87b2-4af3a3e54323-kube-api-access-88ssn\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131344 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5z85n\" (UniqueName: \"kubernetes.io/projected/32df7e35-cd92-413d-8b1d-7e671a424340-kube-api-access-5z85n\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131370 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04f83630-51e2-45e2-bc2b-e41ee082f0df-kubelet-config\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131391 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-serviceca\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131437 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-run-ovn-kubernetes\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-tmp-dir\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131491 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/399c7d20-a955-436c-87b2-4af3a3e54323-host-run-ovn-kubernetes\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131540 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-netns\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-cni-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131616 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c827a3-ec23-46fc-b489-e29235cdcc12-cni-binary-copy\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/04f83630-51e2-45e2-bc2b-e41ee082f0df-kubelet-config\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-kubernetes\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131675 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-tmp\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131689 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-multus-cni-dir\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131723 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8c827a3-ec23-46fc-b489-e29235cdcc12-host-run-netns\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131729 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-env-overrides\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.134549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131741 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/399c7d20-a955-436c-87b2-4af3a3e54323-ovnkube-config\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.135027 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131804 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-serviceca\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.135027 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.131987 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a62f4372-edb5-4df4-aca5-7a17c9178640-iptables-alerter-script\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.135027 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.132010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8c827a3-ec23-46fc-b489-e29235cdcc12-cni-binary-copy\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.135027 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.134630 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/399c7d20-a955-436c-87b2-4af3a3e54323-ovn-node-metrics-cert\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.148721 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.148693 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9vtb\" (UniqueName: \"kubernetes.io/projected/e8c827a3-ec23-46fc-b489-e29235cdcc12-kube-api-access-p9vtb\") pod \"multus-qvnbh\" (UID: \"e8c827a3-ec23-46fc-b489-e29235cdcc12\") " pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.148826 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.148803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9vz\" (UniqueName: \"kubernetes.io/projected/77750d0e-98c8-44fd-8c47-d4ffd9f4e045-kube-api-access-jd9vz\") pod \"aws-ebs-csi-driver-node-kqczd\" (UID: \"77750d0e-98c8-44fd-8c47-d4ffd9f4e045\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.148866 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.148810 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9ggq\" (UniqueName: \"kubernetes.io/projected/c6dc3e32-7f48-46a0-be9f-518cdd0243e2-kube-api-access-h9ggq\") pod \"node-ca-mcvs8\" (UID: \"c6dc3e32-7f48-46a0-be9f-518cdd0243e2\") " pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.149114 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.149097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88ssn\" (UniqueName: \"kubernetes.io/projected/399c7d20-a955-436c-87b2-4af3a3e54323-kube-api-access-88ssn\") pod \"ovnkube-node-zg8vk\" (UID: \"399c7d20-a955-436c-87b2-4af3a3e54323\") " pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.149489 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.149471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z85n\" (UniqueName: \"kubernetes.io/projected/32df7e35-cd92-413d-8b1d-7e671a424340-kube-api-access-5z85n\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.149557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.149498 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9pfv\" (UniqueName: \"kubernetes.io/projected/119157d2-7837-4563-9a73-ef1e3f214237-kube-api-access-k9pfv\") pod \"multus-additional-cni-plugins-28tvp\" (UID: \"119157d2-7837-4563-9a73-ef1e3f214237\") " pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.154347 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.154333 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:22.154407 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.154352 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:22.154407 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.154361 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:22.154479 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.154407 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:22.654394716 +0000 UTC m=+2.053125549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:22.156401 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.156382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzhzh\" (UniqueName: \"kubernetes.io/projected/1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63-kube-api-access-zzhzh\") pod \"node-resolver-dr9pl\" (UID: \"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63\") " pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.163143 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.163123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-967gz\" (UniqueName: \"kubernetes.io/projected/a62f4372-edb5-4df4-aca5-7a17c9178640-kube-api-access-967gz\") pod \"iptables-alerter-nbgmm\" (UID: \"a62f4372-edb5-4df4-aca5-7a17c9178640\") " pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.231958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.231927 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34339983-2b0c-4d12-98e3-adee17a94e20-konnectivity-ca\") pod \"konnectivity-agent-6zsmw\" (UID: \"34339983-2b0c-4d12-98e3-adee17a94e20\") " pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.231958 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.231968 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-systemd\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.231985 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-lib-modules\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-systemd\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232061 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysconfig\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232092 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-host\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232107 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-lib-modules\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232122 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysconfig\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232127 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-run\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232183 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34339983-2b0c-4d12-98e3-adee17a94e20-agent-certs\") pod \"konnectivity-agent-6zsmw\" (UID: \"34339983-2b0c-4d12-98e3-adee17a94e20\") " pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-host\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232213 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysctl-conf\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232222 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-run\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232273 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-sys\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232316 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-sys\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232315 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-modprobe-d\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysctl-conf\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232373 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysctl-d\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-modprobe-d\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232405 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-tuned\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232466 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-kubernetes\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232476 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-sysctl-d\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232488 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-tmp\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232514 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsknb\" (UniqueName: \"kubernetes.io/projected/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-kube-api-access-wsknb\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-kubernetes\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232546 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-var-lib-kubelet\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232609 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-var-lib-kubelet\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.232759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.232512 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34339983-2b0c-4d12-98e3-adee17a94e20-konnectivity-ca\") pod \"konnectivity-agent-6zsmw\" (UID: \"34339983-2b0c-4d12-98e3-adee17a94e20\") " pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.234491 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.234471 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-tmp\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.234612 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.234597 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-etc-tuned\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.234657 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.234648 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34339983-2b0c-4d12-98e3-adee17a94e20-agent-certs\") pod \"konnectivity-agent-6zsmw\" (UID: \"34339983-2b0c-4d12-98e3-adee17a94e20\") " pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.237552 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.237536 2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:22.240837 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.240819 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsknb\" (UniqueName: \"kubernetes.io/projected/4a70bc0a-50f5-4a4a-8d52-d0cdc9092408-kube-api-access-wsknb\") pod \"tuned-czqtp\" (UID: \"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408\") " pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.338219 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.338127 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dr9pl" Jun 02 21:41:22.345052 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.345027 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f8ab5c2_bd9b_4df5_9dbf_78a26dacdd63.slice/crio-36a65993fcd3727f753e6c3ee05ef8340e201d3f38f393fda373fb108ca64d96 WatchSource:0}: Error finding container 36a65993fcd3727f753e6c3ee05ef8340e201d3f38f393fda373fb108ca64d96: Status 404 returned error can't find the container with id 36a65993fcd3727f753e6c3ee05ef8340e201d3f38f393fda373fb108ca64d96 Jun 02 21:41:22.352216 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.352197 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mcvs8" Jun 02 21:41:22.359222 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.359196 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6dc3e32_7f48_46a0_be9f_518cdd0243e2.slice/crio-ade6a9e577ea5656c24cee2b0c6472592975531840185e2ff05809a6efc737a8 WatchSource:0}: Error finding container ade6a9e577ea5656c24cee2b0c6472592975531840185e2ff05809a6efc737a8: Status 404 returned error can't find the container with id ade6a9e577ea5656c24cee2b0c6472592975531840185e2ff05809a6efc737a8 Jun 02 21:41:22.375933 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.375906 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qvnbh" Jun 02 21:41:22.381607 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.381573 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c827a3_ec23_46fc_b489_e29235cdcc12.slice/crio-cb604d9444bb5d565b69ea69e4d001705bd8a907df3cd290045a8db0dbc995a7 WatchSource:0}: Error finding container cb604d9444bb5d565b69ea69e4d001705bd8a907df3cd290045a8db0dbc995a7: Status 404 returned error can't find the container with id cb604d9444bb5d565b69ea69e4d001705bd8a907df3cd290045a8db0dbc995a7 Jun 02 21:41:22.393658 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.393637 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" Jun 02 21:41:22.399494 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.399469 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77750d0e_98c8_44fd_8c47_d4ffd9f4e045.slice/crio-a0ec6a943455752ede1aeeb1250c0463d27ac389ffbfc01b9005956efb644c69 WatchSource:0}: Error finding container a0ec6a943455752ede1aeeb1250c0463d27ac389ffbfc01b9005956efb644c69: Status 404 returned error can't find the container with id a0ec6a943455752ede1aeeb1250c0463d27ac389ffbfc01b9005956efb644c69 Jun 02 21:41:22.399587 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.399511 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-28tvp" Jun 02 21:41:22.406321 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.406304 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:22.407088 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.407067 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119157d2_7837_4563_9a73_ef1e3f214237.slice/crio-e160bea163559ad7aa77754725249e0c58b43d4b02f257c73d52d237360c0c22 WatchSource:0}: Error finding container e160bea163559ad7aa77754725249e0c58b43d4b02f257c73d52d237360c0c22: Status 404 returned error can't find the container with id e160bea163559ad7aa77754725249e0c58b43d4b02f257c73d52d237360c0c22 Jun 02 21:41:22.412543 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.412523 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399c7d20_a955_436c_87b2_4af3a3e54323.slice/crio-507b5ea5cc96c8b22190add84fd08555f081d086e2f286ae8a5c9c9b7065af85 WatchSource:0}: Error finding container 507b5ea5cc96c8b22190add84fd08555f081d086e2f286ae8a5c9c9b7065af85: Status 404 returned error can't find the container with id 507b5ea5cc96c8b22190add84fd08555f081d086e2f286ae8a5c9c9b7065af85 Jun 02 21:41:22.412613 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.412596 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nbgmm" Jun 02 21:41:22.418597 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.418578 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:22.423306 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.423140 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-czqtp" Jun 02 21:41:22.425101 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.425077 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34339983_2b0c_4d12_98e3_adee17a94e20.slice/crio-b4b829de451be0fc185589c70f3cd371e87d69255fa49e49709e9fcfee1a788f WatchSource:0}: Error finding container b4b829de451be0fc185589c70f3cd371e87d69255fa49e49709e9fcfee1a788f: Status 404 returned error can't find the container with id b4b829de451be0fc185589c70f3cd371e87d69255fa49e49709e9fcfee1a788f Jun 02 21:41:22.429791 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:41:22.429772 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a70bc0a_50f5_4a4a_8d52_d0cdc9092408.slice/crio-556fea4dc600d92d35aa024ad26987a7198617f5997740fb457e81f000b65fcf WatchSource:0}: Error finding container 556fea4dc600d92d35aa024ad26987a7198617f5997740fb457e81f000b65fcf: Status 404 returned error can't find the container with id 556fea4dc600d92d35aa024ad26987a7198617f5997740fb457e81f000b65fcf Jun 02 21:41:22.635770 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.635687 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:22.635770 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.635731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:22.635921 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.635835 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:22.635921 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.635884 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:23.635871001 +0000 UTC m=+3.034601850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:22.635921 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.635835 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:22.635921 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.635914 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:41:23.635907984 +0000 UTC m=+3.034638816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:22.737313 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:22.736680 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:22.737313 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.736863 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:22.737313 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.736883 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:22.737313 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.736896 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:22.737313 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:22.736958 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:23.736937497 +0000 UTC m=+3.135668330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:23.049744 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.049705 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:36:22 +0000 UTC" deadline="2027-12-10 23:40:34.46221453 +0000 UTC" Jun 02 21:41:23.049744 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.049741 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13345h59m11.412476959s" Jun 02 21:41:23.113836 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.113335 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:23.113836 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.113467 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:23.127700 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.127665 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mcvs8" event={"ID":"c6dc3e32-7f48-46a0-be9f-518cdd0243e2","Type":"ContainerStarted","Data":"ade6a9e577ea5656c24cee2b0c6472592975531840185e2ff05809a6efc737a8"} Jun 02 21:41:23.138400 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.138369 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbgmm" event={"ID":"a62f4372-edb5-4df4-aca5-7a17c9178640","Type":"ContainerStarted","Data":"98d192ee9e25de51d19174bd9c9e79fbccd954ac3cc852d7afe51de762283af8"} Jun 02 21:41:23.140085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.140063 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"507b5ea5cc96c8b22190add84fd08555f081d086e2f286ae8a5c9c9b7065af85"} Jun 02 21:41:23.151630 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.151573 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerStarted","Data":"e160bea163559ad7aa77754725249e0c58b43d4b02f257c73d52d237360c0c22"} Jun 02 21:41:23.169284 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.169254 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" event={"ID":"77750d0e-98c8-44fd-8c47-d4ffd9f4e045","Type":"ContainerStarted","Data":"a0ec6a943455752ede1aeeb1250c0463d27ac389ffbfc01b9005956efb644c69"} Jun 02 21:41:23.176628 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.176595 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qvnbh" event={"ID":"e8c827a3-ec23-46fc-b489-e29235cdcc12","Type":"ContainerStarted","Data":"cb604d9444bb5d565b69ea69e4d001705bd8a907df3cd290045a8db0dbc995a7"} Jun 02 21:41:23.184477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.184416 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dr9pl" event={"ID":"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63","Type":"ContainerStarted","Data":"36a65993fcd3727f753e6c3ee05ef8340e201d3f38f393fda373fb108ca64d96"} Jun 02 21:41:23.204554 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.204518 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czqtp" event={"ID":"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408","Type":"ContainerStarted","Data":"556fea4dc600d92d35aa024ad26987a7198617f5997740fb457e81f000b65fcf"} Jun 02 21:41:23.221673 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.221635 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zsmw" event={"ID":"34339983-2b0c-4d12-98e3-adee17a94e20","Type":"ContainerStarted","Data":"b4b829de451be0fc185589c70f3cd371e87d69255fa49e49709e9fcfee1a788f"} Jun 02 21:41:23.400897 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.400638 2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 21:41:23.645054 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.645019 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:23.645250 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.645068 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:23.645250 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.645237 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:23.645400 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.645299 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:25.645280152 +0000 UTC m=+5.044010987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:23.645713 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.645689 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:23.645808 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.645742 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:41:25.645728339 +0000 UTC m=+5.044459171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:23.746505 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:23.746468 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:23.746695 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.746609 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:23.746695 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.746636 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:23.746695 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.746651 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:23.746851 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:23.746712 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:25.74669302 +0000 UTC m=+5.145423868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:24.050274 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:24.050181 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 21:36:22 +0000 UTC" deadline="2028-02-13 22:32:50.740731946 +0000 UTC" Jun 02 21:41:24.050274 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:24.050221 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14904h51m26.690514425s" Jun 02 21:41:24.104337 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:24.103766 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:24.104337 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:24.103906 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:24.104337 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:24.104126 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:24.104337 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:24.104245 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:25.108092 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:25.107610 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:25.108092 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.107743 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:25.661660 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:25.660805 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:25.661660 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:25.660909 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:25.661660 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.661030 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:25.661660 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.661095 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:41:29.661076612 +0000 UTC m=+9.059807449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:25.661660 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.661512 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:25.661660 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.661564 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:29.661548773 +0000 UTC m=+9.060279611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:25.761361 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:25.761310 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:25.761526 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.761498 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:25.761605 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.761528 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:25.761605 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.761542 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:25.761706 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:25.761613 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:29.761592385 +0000 UTC m=+9.160323227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:26.103486 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:26.103453 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:26.103672 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:26.103590 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:26.103779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:26.103675 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:26.103837 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:26.103789 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:27.104412 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:27.104366 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:27.104920 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:27.104509 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:28.103321 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:28.103285 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:28.103506 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:28.103285 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:28.103506 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:28.103439 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:28.103506 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:28.103460 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:29.103608 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:29.103574 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:29.104029 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.103712 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:29.693741 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:29.693695 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:29.693741 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:29.693748 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:29.693971 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.693856 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:29.693971 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.693926 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:41:37.693907343 +0000 UTC m=+17.092638181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:29.693971 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.693936 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:29.694143 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.693993 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:37.693975138 +0000 UTC m=+17.092705977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:29.794847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:29.794471 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:29.794847 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.794648 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:29.794847 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.794667 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:29.794847 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.794682 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:29.794847 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:29.794744 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:37.794725607 +0000 UTC m=+17.193456463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:30.103208 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:30.103144 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:30.103383 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:30.103302 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:30.103456 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:30.103435 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:30.103561 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:30.103526 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:31.104832 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:31.104793 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:31.105180 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:31.104930 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:32.104096 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:32.104061 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:32.104304 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:32.104223 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:32.104375 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:32.104324 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:32.104423 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:32.104397 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:33.104069 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:33.104030 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:33.104512 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:33.104198 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:34.103561 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:34.103504 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:34.103737 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:34.103578 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:34.103737 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:34.103656 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:34.103880 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:34.103786 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:35.103492 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:35.103462 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:35.103897 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:35.103580 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:36.103482 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:36.103444 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:36.103647 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:36.103450 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:36.103647 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:36.103563 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:36.104073 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:36.103682 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:37.103311 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:37.103275 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:37.103517 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.103421 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:37.762550 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:37.762518 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:37.762975 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:37.762616 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:37.762975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.762695 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:37.762975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.762721 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:37.762975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.762778 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:53.762751656 +0000 UTC m=+33.161482495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:37.762975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.762798 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:41:53.76278813 +0000 UTC m=+33.161518976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:37.863139 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:37.863106 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:37.863314 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.863281 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:37.863314 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.863303 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:37.863314 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.863317 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:37.863513 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:37.863369 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:53.863353312 +0000 UTC m=+33.262084148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:38.104016 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:38.103983 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:38.104190 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:38.104105 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:38.104190 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:38.104178 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:38.104300 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:38.104273 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:39.104035 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:39.104003 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:39.104448 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:39.104135 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:40.103504 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:40.103470 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:40.103681 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:40.103541 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:40.103681 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:40.103656 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:40.103844 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:40.103811 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:41.103796 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:41.103765 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:41.104243 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:41.103871 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:42.103717 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.103674 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:42.103871 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:42.103818 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:42.103871 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.103858 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:42.104325 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:42.103971 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:42.256513 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.256480 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"25cc75d43d10e2cd88f55b9e9449bca4bfdf5bcc3e51f23d03da0bb3bcf09145"} Jun 02 21:41:42.256621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.256520 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"8a2415c597f5ad250c13339a9aba59f7b92f1622c1fa7b81c6bd866f4e40dbe2"} Jun 02 21:41:42.257672 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.257646 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qvnbh" event={"ID":"e8c827a3-ec23-46fc-b489-e29235cdcc12","Type":"ContainerStarted","Data":"28168d4dcfaeaa0c027e485035368037875ef20753d50f5fbe5d2b01bea49398"} Jun 02 21:41:42.258767 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.258745 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"00ab6e9e70b3869b45a8dbd4d89dd58d","Type":"ContainerStarted","Data":"a3a16f469afd5f03ca5f54b02f69794f3ddcb6f5a3f992fef35e1d5832c01706"} Jun 02 21:41:42.259781 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.259756 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-czqtp" event={"ID":"4a70bc0a-50f5-4a4a-8d52-d0cdc9092408","Type":"ContainerStarted","Data":"f6fd16b4d48bb2620bb78abc04aadb2cd7d6e14edc67d1798ab5d503eddba321"} Jun 02 21:41:42.289955 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.288611 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-qvnbh" podStartSLOduration=2.131346302 podStartE2EDuration="21.288590365s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.38301943 +0000 UTC m=+1.781750263" lastFinishedPulling="2026-06-02 21:41:41.54026348 +0000 UTC m=+20.938994326" observedRunningTime="2026-06-02 21:41:42.271074896 +0000 UTC m=+21.669805769" watchObservedRunningTime="2026-06-02 21:41:42.288590365 +0000 UTC m=+21.687321223" Jun 02 21:41:42.300998 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:42.300797 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-czqtp" podStartSLOduration=2.220188786 podStartE2EDuration="21.300779433s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.43114509 +0000 UTC m=+1.829875923" lastFinishedPulling="2026-06-02 21:41:41.51173573 +0000 UTC m=+20.910466570" observedRunningTime="2026-06-02 21:41:42.289686556 +0000 UTC m=+21.688417431" watchObservedRunningTime="2026-06-02 21:41:42.300779433 +0000 UTC m=+21.699510290" Jun 02 21:41:43.103315 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.103277 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:43.103535 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:43.103435 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:43.262698 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.262665 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nbgmm" event={"ID":"a62f4372-edb5-4df4-aca5-7a17c9178640","Type":"ContainerStarted","Data":"a048b708283d3c549a2da49401c2dcb5e65caf55d6f0bc62ac71c4c518f8d725"} Jun 02 21:41:43.265524 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.265457 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"4730ac3e0f85b6d08d698450fe8ff08305bd35f062fbf33e4580e98db611179f"} Jun 02 21:41:43.265524 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.265489 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"51626b2734449a9175056f1b1bb93b2f8e593c36280b0abcd7c00f214d4efbb5"} Jun 02 21:41:43.265524 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.265503 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"ee806c11de15bf5d125108b89b4bb5273129fd024c78cc290528d59fde9fc553"} Jun 02 21:41:43.265524 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.265512 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"c333df034058a9055363ac2869ef3837692fded1659abbce0d034fdcae220188"} Jun 02 21:41:43.266826 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.266803 2565 generic.go:358] "Generic (PLEG): container finished" podID="119157d2-7837-4563-9a73-ef1e3f214237" containerID="0fe731896d37e14d583ced3252faa14fee00545472ba85e3f030d763d39e51e0" exitCode=0 Jun 02 21:41:43.266921 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.266861 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerDied","Data":"0fe731896d37e14d583ced3252faa14fee00545472ba85e3f030d763d39e51e0"} Jun 02 21:41:43.268475 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.268451 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" event={"ID":"77750d0e-98c8-44fd-8c47-d4ffd9f4e045","Type":"ContainerStarted","Data":"ac47fe0b6901d16d825f0fa85fd96dd1ecd851fe157fda3648bc2092183d4dcf"} Jun 02 21:41:43.269970 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.269947 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dr9pl" event={"ID":"1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63","Type":"ContainerStarted","Data":"92645259c8f164816bbf7c42dfdbfc99530101a33bdaa6dd6300a172890dd2f3"} Jun 02 21:41:43.271278 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.271239 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6zsmw" event={"ID":"34339983-2b0c-4d12-98e3-adee17a94e20","Type":"ContainerStarted","Data":"099bba01116623ce0e0a4b6041e4cfdda91fb6fee5bb75c60239e52dd3a64a5a"} Jun 02 21:41:43.272702 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.272681 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mcvs8" event={"ID":"c6dc3e32-7f48-46a0-be9f-518cdd0243e2","Type":"ContainerStarted","Data":"4b67ca97850ade501faedfb4bda41dd23a09af64ad3b7f96374631d981a193bd"} Jun 02 21:41:43.274491 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.274469 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 21:41:43.274673 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.274645 2565 generic.go:358] "Generic (PLEG): container finished" podID="4669e9fdc58fcc49647e48b529e468a8" containerID="ae629509e69a8171c9e70c60729b97835dcd3fdf84d7d43e3ab7866490595af0" exitCode=0 Jun 02 21:41:43.274765 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.274744 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"4669e9fdc58fcc49647e48b529e468a8","Type":"ContainerDied","Data":"ae629509e69a8171c9e70c60729b97835dcd3fdf84d7d43e3ab7866490595af0"} Jun 02 21:41:43.296050 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.296006 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" podStartSLOduration=22.295991878 podStartE2EDuration="22.295991878s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:41:42.301563738 +0000 UTC m=+21.700294594" watchObservedRunningTime="2026-06-02 21:41:43.295991878 +0000 UTC m=+22.694722733" Jun 02 21:41:43.296792 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.296753 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nbgmm" podStartSLOduration=3.208744027 podStartE2EDuration="22.296739965s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.421822535 +0000 UTC m=+1.820553368" lastFinishedPulling="2026-06-02 21:41:41.509818457 +0000 UTC m=+20.908549306" observedRunningTime="2026-06-02 21:41:43.295609387 +0000 UTC m=+22.694340255" watchObservedRunningTime="2026-06-02 21:41:43.296739965 +0000 UTC m=+22.695470823" Jun 02 21:41:43.313199 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.313135 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6zsmw" podStartSLOduration=3.230329866 podStartE2EDuration="22.313119501s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.426867189 +0000 UTC m=+1.825598034" lastFinishedPulling="2026-06-02 21:41:41.509656833 +0000 UTC m=+20.908387669" observedRunningTime="2026-06-02 21:41:43.312402115 +0000 UTC m=+22.711132971" watchObservedRunningTime="2026-06-02 21:41:43.313119501 +0000 UTC m=+22.711850358" Jun 02 21:41:43.351244 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:43.351204 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mcvs8" podStartSLOduration=3.202345321 podStartE2EDuration="22.351191705s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.360708182 +0000 UTC m=+1.759439018" lastFinishedPulling="2026-06-02 21:41:41.509554554 +0000 UTC m=+20.908285402" observedRunningTime="2026-06-02 21:41:43.351068482 +0000 UTC m=+22.749799338" watchObservedRunningTime="2026-06-02 21:41:43.351191705 +0000 UTC m=+22.749922590" Jun 02 21:41:44.087738 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.087603 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T21:41:43.274488649Z","UUID":"953248cd-590f-40bb-bf28-1736811e70a1","Handler":null,"Name":"","Endpoint":""} Jun 02 21:41:44.089936 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.089907 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 21:41:44.089936 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.089940 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 21:41:44.104089 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.104064 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:44.104236 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.104064 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:44.104236 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:44.104198 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:44.104337 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:44.104273 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:44.277493 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.277464 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" event={"ID":"77750d0e-98c8-44fd-8c47-d4ffd9f4e045","Type":"ContainerStarted","Data":"628ec23660d6c4069c86c8cc47c3f4bb403112bf4b6423a24ae65dc80f76214b"} Jun 02 21:41:44.277837 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.277503 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" event={"ID":"77750d0e-98c8-44fd-8c47-d4ffd9f4e045","Type":"ContainerStarted","Data":"bd73c60f0148482cc7b51143ccd20f3980e77fff76d5272b0d8f53eef12299cd"} Jun 02 21:41:44.279110 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.279084 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"4669e9fdc58fcc49647e48b529e468a8","Type":"ContainerStarted","Data":"18b3b7ea46ea20429c692e4b59cf65779800ddbd858fbe65ad50dfc71630c981"} Jun 02 21:41:44.300203 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.300141 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqczd" podStartSLOduration=1.521009042 podStartE2EDuration="23.300128447s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.402818976 +0000 UTC m=+1.801549823" lastFinishedPulling="2026-06-02 21:41:44.181938388 +0000 UTC m=+23.580669228" observedRunningTime="2026-06-02 21:41:44.299958937 +0000 UTC m=+23.698689792" watchObservedRunningTime="2026-06-02 21:41:44.300128447 +0000 UTC m=+23.698859301" Jun 02 21:41:44.300793 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.300763 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-dr9pl" podStartSLOduration=4.137994565 podStartE2EDuration="23.300755516s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.346607854 +0000 UTC m=+1.745338687" lastFinishedPulling="2026-06-02 21:41:41.509368789 +0000 UTC m=+20.908099638" observedRunningTime="2026-06-02 21:41:43.450504054 +0000 UTC m=+22.849234910" watchObservedRunningTime="2026-06-02 21:41:44.300755516 +0000 UTC m=+23.699486371" Jun 02 21:41:44.315564 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:44.315487 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" podStartSLOduration=23.315470916 podStartE2EDuration="23.315470916s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:41:44.315312292 +0000 UTC m=+23.714043148" watchObservedRunningTime="2026-06-02 21:41:44.315470916 +0000 UTC m=+23.714201761" Jun 02 21:41:45.104477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:45.104294 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:45.104653 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:45.104574 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:45.283056 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:45.283020 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"cf656e64517d15e239455a84290fec483621159ae5b3e4104653708f4bddea4f"} Jun 02 21:41:46.103974 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:46.103943 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:46.104200 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:46.104063 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:46.104200 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:46.104108 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:46.104305 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:46.104203 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:47.103427 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:47.103381 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:47.103901 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:47.103544 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:47.535961 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:47.535921 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:47.536644 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:47.536622 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:48.103590 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:48.103556 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:48.103942 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:48.103663 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:48.103942 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:48.103716 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:48.103942 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:48.103794 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:48.288580 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:48.288552 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:48.289148 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:48.289132 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6zsmw" Jun 02 21:41:49.103444 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.103258 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:49.103598 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:49.103522 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:49.292879 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.292843 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" event={"ID":"399c7d20-a955-436c-87b2-4af3a3e54323","Type":"ContainerStarted","Data":"204d4085a8a8c2f18f2bc3317eb9090d00d92a6f196ef87820461f4fa4adb6fc"} Jun 02 21:41:49.293587 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.293141 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:49.294478 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.294446 2565 generic.go:358] "Generic (PLEG): container finished" podID="119157d2-7837-4563-9a73-ef1e3f214237" containerID="66165f4cfb65af5e61bab98e280ddd7709ec0c271d306bc12f5ed1abfdae0fa2" exitCode=0 Jun 02 21:41:49.294587 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.294512 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerDied","Data":"66165f4cfb65af5e61bab98e280ddd7709ec0c271d306bc12f5ed1abfdae0fa2"} Jun 02 21:41:49.309509 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.309484 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:49.317090 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:49.317051 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" podStartSLOduration=8.716722269 podStartE2EDuration="28.317040275s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.413941775 +0000 UTC m=+1.812672607" lastFinishedPulling="2026-06-02 21:41:42.014259767 +0000 UTC m=+21.412990613" observedRunningTime="2026-06-02 21:41:49.315932992 +0000 UTC m=+28.714663846" watchObservedRunningTime="2026-06-02 21:41:49.317040275 +0000 UTC m=+28.715771130" Jun 02 21:41:50.103324 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.103289 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:50.103467 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.103288 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:50.103467 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:50.103412 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:50.103531 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:50.103477 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:50.256928 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.256891 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8lgz"] Jun 02 21:41:50.260070 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.260032 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lcfdg"] Jun 02 21:41:50.260856 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.260831 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ss85j"] Jun 02 21:41:50.260984 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.260970 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:50.261091 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:50.261073 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:50.299060 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.299031 2565 generic.go:358] "Generic (PLEG): container finished" podID="119157d2-7837-4563-9a73-ef1e3f214237" containerID="e69083993d5694913a45f81e28991157248820e8607af3622976bfae754f7137" exitCode=0 Jun 02 21:41:50.299527 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.299124 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:50.299527 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.299119 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerDied","Data":"e69083993d5694913a45f81e28991157248820e8607af3622976bfae754f7137"} Jun 02 21:41:50.299527 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.299366 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 21:41:50.299527 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:50.299435 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:50.299701 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.299525 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:50.299739 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.299710 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:50.300275 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:50.300185 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:50.315818 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:50.315797 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:51.304296 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:51.304263 2565 generic.go:358] "Generic (PLEG): container finished" podID="119157d2-7837-4563-9a73-ef1e3f214237" containerID="7f3186094792bb09ffebe43d6dad94afe4f60e308cbe2001899f0bc4e155310c" exitCode=0 Jun 02 21:41:51.304685 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:51.304342 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerDied","Data":"7f3186094792bb09ffebe43d6dad94afe4f60e308cbe2001899f0bc4e155310c"} Jun 02 21:41:51.304685 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:51.304570 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 21:41:52.104029 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:52.103804 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:52.104242 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:52.103833 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:52.104242 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:52.104127 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:52.104242 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:52.104223 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:52.104407 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:52.103868 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:52.104407 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:52.104326 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:52.182290 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:52.182255 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:41:53.328426 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:53.328378 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" podUID="399c7d20-a955-436c-87b2-4af3a3e54323" containerName="ovnkube-controller" probeResult="failure" output="" Jun 02 21:41:53.789370 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:53.789335 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:53.789370 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:53.789384 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:53.789718 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.789490 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:53.789718 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.789548 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:25.789528508 +0000 UTC m=+65.188259359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 21:41:53.789718 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.789583 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:53.789718 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.789635 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret podName:04f83630-51e2-45e2-bc2b-e41ee082f0df nodeName:}" failed. No retries permitted until 2026-06-02 21:42:25.789618712 +0000 UTC m=+65.188349547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret") pod "global-pull-secret-syncer-s8lgz" (UID: "04f83630-51e2-45e2-bc2b-e41ee082f0df") : object "kube-system"/"original-pull-secret" not registered Jun 02 21:41:53.890036 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:53.890003 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:53.890235 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.890206 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 21:41:53.890315 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.890236 2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 21:41:53.890315 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.890250 2565 projected.go:194] Error preparing data for projected volume kube-api-access-fcxrv for pod openshift-network-diagnostics/network-check-target-lcfdg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:53.890315 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:53.890312 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv podName:04f018e4-f338-4932-b2fe-b4cfb18eb947 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:25.890293028 +0000 UTC m=+65.289023865 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fcxrv" (UniqueName: "kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv") pod "network-check-target-lcfdg" (UID: "04f018e4-f338-4932-b2fe-b4cfb18eb947") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 21:41:54.104210 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:54.104112 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:54.104362 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:54.104252 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:54.104425 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:54.104263 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:41:54.104425 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:54.104370 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lcfdg" podUID="04f018e4-f338-4932-b2fe-b4cfb18eb947" Jun 02 21:41:54.104425 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:54.104419 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:54.104571 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:54.104526 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s8lgz" podUID="04f83630-51e2-45e2-bc2b-e41ee082f0df" Jun 02 21:41:55.405430 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.405400 2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeReady" Jun 02 21:41:55.405963 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.405529 2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 21:41:55.439107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.439078 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-769ff5485f-lwr8j"] Jun 02 21:41:55.493832 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.493800 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jl288"] Jun 02 21:41:55.494014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.493952 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.498193 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.497491 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 21:41:55.498193 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.497645 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 21:41:55.498193 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.497801 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 21:41:55.498443 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.498318 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtd5q\"" Jun 02 21:41:55.514795 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.514767 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 21:41:55.516825 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.516803 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-769ff5485f-lwr8j"] Jun 02 21:41:55.516825 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.516828 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nt5bn"] Jun 02 21:41:55.516975 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.516950 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.519130 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.519109 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssb95\"" Jun 02 21:41:55.519256 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.519109 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 21:41:55.519391 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.519378 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 21:41:55.538936 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.538910 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jl288"] Jun 02 21:41:55.538936 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.538940 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nt5bn"] Jun 02 21:41:55.539124 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.539052 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:55.541440 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.541416 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jrx\"" Jun 02 21:41:55.541679 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.541576 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 21:41:55.541855 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.541837 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 21:41:55.542355 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.542333 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 21:41:55.602373 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsn8v\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-kube-api-access-tsn8v\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602373 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-trusted-ca\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602616 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-image-registry-private-configuration\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602616 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602616 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-registry-certificates\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602616 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b49276d-9a26-444b-a804-290eb1404afe-ca-trust-extracted\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602616 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-installation-pull-secrets\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.602862 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.602646 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-bound-sa-token\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.703698 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703616 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsn8v\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-kube-api-access-tsn8v\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.703698 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703674 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-trusted-ca\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.703920 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.703920 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703750 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-image-registry-private-configuration\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.703920 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703810 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.703920 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703871 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-registry-certificates\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmh56\" (UniqueName: \"kubernetes.io/projected/2773cab1-6497-45e0-9f61-27c15620ad0c-kube-api-access-mmh56\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.703958 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b49276d-9a26-444b-a804-290eb1404afe-ca-trust-extracted\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.703969 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.704001 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704024 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-installation-pull-secrets\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.704066 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:41:56.204044633 +0000 UTC m=+35.602775468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:41:55.704106 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2773cab1-6497-45e0-9f61-27c15620ad0c-config-volume\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.704450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704140 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-bound-sa-token\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.704450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704329 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b49276d-9a26-444b-a804-290eb1404afe-ca-trust-extracted\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.704559 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2773cab1-6497-45e0-9f61-27c15620ad0c-tmp-dir\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.704559 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:55.704647 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65p5n\" (UniqueName: \"kubernetes.io/projected/7db682da-cedd-4e2b-9880-cc2ed25ab154-kube-api-access-65p5n\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:55.704775 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704745 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-registry-certificates\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.704898 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.704812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-trusted-ca\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.709074 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.709052 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-installation-pull-secrets\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.709195 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.709052 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-image-registry-private-configuration\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.730761 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.730730 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-bound-sa-token\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.731222 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.731203 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsn8v\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-kube-api-access-tsn8v\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:55.805755 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.805716 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.805931 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.805879 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:41:55.805931 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.805908 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmh56\" (UniqueName: \"kubernetes.io/projected/2773cab1-6497-45e0-9f61-27c15620ad0c-kube-api-access-mmh56\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.806045 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.805956 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:41:56.305931898 +0000 UTC m=+35.704662752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:41:55.806045 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.806008 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2773cab1-6497-45e0-9f61-27c15620ad0c-config-volume\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.806045 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.806042 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2773cab1-6497-45e0-9f61-27c15620ad0c-tmp-dir\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.806235 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.806068 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:55.806235 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.806096 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65p5n\" (UniqueName: \"kubernetes.io/projected/7db682da-cedd-4e2b-9880-cc2ed25ab154-kube-api-access-65p5n\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:55.806235 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.806191 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:41:55.806235 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:55.806228 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:56.306213878 +0000 UTC m=+35.704944711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:41:55.806471 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.806446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2773cab1-6497-45e0-9f61-27c15620ad0c-tmp-dir\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.806729 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.806709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2773cab1-6497-45e0-9f61-27c15620ad0c-config-volume\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.814435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.814413 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmh56\" (UniqueName: \"kubernetes.io/projected/2773cab1-6497-45e0-9f61-27c15620ad0c-kube-api-access-mmh56\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:55.815826 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:55.815806 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65p5n\" (UniqueName: \"kubernetes.io/projected/7db682da-cedd-4e2b-9880-cc2ed25ab154-kube-api-access-65p5n\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:56.103364 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.103326 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:41:56.103557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.103326 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:41:56.103557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.103326 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:41:56.106104 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.106081 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:41:56.106241 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.106137 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8cvg9\"" Jun 02 21:41:56.106241 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.106156 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:41:56.106371 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.106274 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:41:56.106596 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.106579 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 21:41:56.106691 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.106584 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96ccb\"" Jun 02 21:41:56.209574 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.209541 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:56.209761 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.209661 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:41:56.209761 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.209678 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:41:56.209761 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.209752 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:41:57.209733227 +0000 UTC m=+36.608464064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:41:56.311050 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.310991 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:56.311255 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:56.311074 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:56.311255 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.311188 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:41:56.311395 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.311255 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:41:56.311395 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.311277 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:57.311257507 +0000 UTC m=+36.709988346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:41:56.311395 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:56.311314 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:41:57.311296348 +0000 UTC m=+36.710027185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:41:57.219514 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:57.219481 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:57.219975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.219631 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:41:57.219975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.219647 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:41:57.219975 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.219701 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:41:59.219684283 +0000 UTC m=+38.618415126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:41:57.319840 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:57.319813 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:57.319961 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:57.319919 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:57.320021 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.319965 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:41:57.320078 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.320042 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:41:57.320125 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.320045 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:41:59.320025302 +0000 UTC m=+38.718756162 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:41:57.320125 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:57.320103 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:41:59.320086202 +0000 UTC m=+38.718817036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:41:58.319369 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:58.319338 2565 generic.go:358] "Generic (PLEG): container finished" podID="119157d2-7837-4563-9a73-ef1e3f214237" containerID="e92e76b533496722356ed97211e5534fe874db1acb2a29cb512b6ddf4e6da667" exitCode=0 Jun 02 21:41:58.319959 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:58.319386 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerDied","Data":"e92e76b533496722356ed97211e5534fe874db1acb2a29cb512b6ddf4e6da667"} Jun 02 21:41:59.233777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:59.233744 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:41:59.233940 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.233907 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:41:59.233940 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.233926 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:41:59.234010 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.233988 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:42:03.233966323 +0000 UTC m=+42.632697156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:41:59.323253 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:59.323222 2565 generic.go:358] "Generic (PLEG): container finished" podID="119157d2-7837-4563-9a73-ef1e3f214237" containerID="a3d16ece4bd2d1d6e1a08ce6a5cc86b694385af8253e5878813542283b032ef1" exitCode=0 Jun 02 21:41:59.323687 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:59.323276 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerDied","Data":"a3d16ece4bd2d1d6e1a08ce6a5cc86b694385af8253e5878813542283b032ef1"} Jun 02 21:41:59.334910 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:59.334889 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:41:59.335033 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.335019 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:41:59.335070 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:41:59.335048 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:41:59.335070 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.335065 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:42:03.335052247 +0000 UTC m=+42.733783080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:41:59.335144 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.335115 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:41:59.335197 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:41:59.335152 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:03.335140915 +0000 UTC m=+42.733871748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:42:00.328340 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:00.328135 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-28tvp" event={"ID":"119157d2-7837-4563-9a73-ef1e3f214237","Type":"ContainerStarted","Data":"045218ac1512bd7113a6e394b992d28c92cbb3d22206d4b2116ea2f25134172e"} Jun 02 21:42:00.354591 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:00.354528 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-28tvp" podStartSLOduration=4.511419033 podStartE2EDuration="39.354510731s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:41:22.411065733 +0000 UTC m=+1.809796585" lastFinishedPulling="2026-06-02 21:41:57.254157432 +0000 UTC m=+36.652888283" observedRunningTime="2026-06-02 21:42:00.353232159 +0000 UTC m=+39.751963015" watchObservedRunningTime="2026-06-02 21:42:00.354510731 +0000 UTC m=+39.753241592" Jun 02 21:42:03.263258 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:03.263219 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:42:03.263722 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.263368 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:42:03.263722 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.263386 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:42:03.263722 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.263446 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:42:11.263431351 +0000 UTC m=+50.662162183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:42:03.364233 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:03.364189 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:42:03.364426 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.364323 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:03.364426 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:03.364375 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:42:03.364426 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.364383 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:42:11.364366731 +0000 UTC m=+50.763097565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:42:03.364593 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.364501 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:03.364593 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:03.364557 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:11.36454185 +0000 UTC m=+50.763272684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:42:11.321973 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:11.321927 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:42:11.322397 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.322063 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:42:11.322397 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.322081 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:42:11.322397 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.322136 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:42:27.322120639 +0000 UTC m=+66.720851477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:42:11.422951 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:11.422912 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:42:11.423111 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.423070 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:11.423212 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:11.423109 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:42:11.423212 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.423137 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:42:27.423117202 +0000 UTC m=+66.821848036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:42:11.423293 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.423212 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:11.423293 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:11.423264 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:27.423248305 +0000 UTC m=+66.821979139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:42:23.317465 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:23.317432 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zg8vk" Jun 02 21:42:25.828593 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.828554 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:42:25.829004 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.828607 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:42:25.830990 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.830969 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 21:42:25.831076 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.830970 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 21:42:25.839812 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:25.839793 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 21:42:25.839867 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:25.839858 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:29.839841594 +0000 UTC m=+129.238572426 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : secret "metrics-daemon-secret" not found Jun 02 21:42:25.842419 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.842402 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/04f83630-51e2-45e2-bc2b-e41ee082f0df-original-pull-secret\") pod \"global-pull-secret-syncer-s8lgz\" (UID: \"04f83630-51e2-45e2-bc2b-e41ee082f0df\") " pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:42:25.928922 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.928889 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:42:25.931187 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.931155 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 21:42:25.941821 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.941802 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 21:42:25.953173 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:25.953137 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcxrv\" (UniqueName: \"kubernetes.io/projected/04f018e4-f338-4932-b2fe-b4cfb18eb947-kube-api-access-fcxrv\") pod \"network-check-target-lcfdg\" (UID: \"04f018e4-f338-4932-b2fe-b4cfb18eb947\") " pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:42:26.125068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.124997 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8cvg9\"" Jun 02 21:42:26.128646 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.128628 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s8lgz" Jun 02 21:42:26.133316 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.133298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:42:26.294156 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.294124 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lcfdg"] Jun 02 21:42:26.298133 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:42:26.298106 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f018e4_f338_4932_b2fe_b4cfb18eb947.slice/crio-74406d3afe15f514bb038fe70682054fa568f9341c6bd2be85f1e25a99744f4d WatchSource:0}: Error finding container 74406d3afe15f514bb038fe70682054fa568f9341c6bd2be85f1e25a99744f4d: Status 404 returned error can't find the container with id 74406d3afe15f514bb038fe70682054fa568f9341c6bd2be85f1e25a99744f4d Jun 02 21:42:26.306136 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.306113 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s8lgz"] Jun 02 21:42:26.308986 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:42:26.308968 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f83630_51e2_45e2_bc2b_e41ee082f0df.slice/crio-5472e269bf7fdf6ff17dc9f1fc511372fa6a197eb5c579764c13728550cbae8b WatchSource:0}: Error finding container 5472e269bf7fdf6ff17dc9f1fc511372fa6a197eb5c579764c13728550cbae8b: Status 404 returned error can't find the container with id 5472e269bf7fdf6ff17dc9f1fc511372fa6a197eb5c579764c13728550cbae8b Jun 02 21:42:26.375791 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.375713 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lcfdg" event={"ID":"04f018e4-f338-4932-b2fe-b4cfb18eb947","Type":"ContainerStarted","Data":"74406d3afe15f514bb038fe70682054fa568f9341c6bd2be85f1e25a99744f4d"} Jun 02 21:42:26.376540 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:26.376515 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8lgz" event={"ID":"04f83630-51e2-45e2-bc2b-e41ee082f0df","Type":"ContainerStarted","Data":"5472e269bf7fdf6ff17dc9f1fc511372fa6a197eb5c579764c13728550cbae8b"} Jun 02 21:42:27.340518 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:27.340482 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:42:27.340943 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.340650 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:42:27.340943 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.340676 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:42:27.340943 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.340745 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:42:59.340723065 +0000 UTC m=+98.739453899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:42:27.441358 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:27.441253 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:42:27.441544 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.441441 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:27.441544 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:27.441481 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:42:27.441544 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.441513 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:42:59.441493571 +0000 UTC m=+98.840224414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:42:27.441713 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.441555 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:27.441713 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:27.441595 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:42:59.441584994 +0000 UTC m=+98.840315841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:42:31.388873 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:31.388772 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lcfdg" event={"ID":"04f018e4-f338-4932-b2fe-b4cfb18eb947","Type":"ContainerStarted","Data":"a037e1f01231f78d0c4caadc612ec8e02d500b7d1c2c728516f5c7097ff23732"} Jun 02 21:42:31.389441 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:31.388972 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:42:31.390078 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:31.390055 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s8lgz" event={"ID":"04f83630-51e2-45e2-bc2b-e41ee082f0df","Type":"ContainerStarted","Data":"5151f631d1fbfd3673cc905056e0674730a027a747f818a01e6e42772fb95c8f"} Jun 02 21:42:31.402407 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:31.402362 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lcfdg" podStartSLOduration=65.702181696 podStartE2EDuration="1m10.402349751s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:42:26.299916004 +0000 UTC m=+65.698646837" lastFinishedPulling="2026-06-02 21:42:31.000084047 +0000 UTC m=+70.398814892" observedRunningTime="2026-06-02 21:42:31.402034863 +0000 UTC m=+70.800765715" watchObservedRunningTime="2026-06-02 21:42:31.402349751 +0000 UTC m=+70.801080640" Jun 02 21:42:31.414431 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:31.414391 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s8lgz" podStartSLOduration=65.724625714 podStartE2EDuration="1m10.414379407s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:42:26.310422512 +0000 UTC m=+65.709153345" lastFinishedPulling="2026-06-02 21:42:31.000176193 +0000 UTC m=+70.398907038" observedRunningTime="2026-06-02 21:42:31.413722991 +0000 UTC m=+70.812453845" watchObservedRunningTime="2026-06-02 21:42:31.414379407 +0000 UTC m=+70.813110262" Jun 02 21:42:59.371514 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:59.371464 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:42:59.371944 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.371615 2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 21:42:59.371944 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.371635 2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-769ff5485f-lwr8j: secret "image-registry-tls" not found Jun 02 21:42:59.371944 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.371702 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls podName:9b49276d-9a26-444b-a804-290eb1404afe nodeName:}" failed. No retries permitted until 2026-06-02 21:44:03.371686148 +0000 UTC m=+162.770416982 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls") pod "image-registry-769ff5485f-lwr8j" (UID: "9b49276d-9a26-444b-a804-290eb1404afe") : secret "image-registry-tls" not found Jun 02 21:42:59.472050 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:59.472020 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:42:59.472230 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:42:59.472079 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:42:59.472230 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.472175 2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 21:42:59.472230 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.472179 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 21:42:59.472335 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.472236 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls podName:2773cab1-6497-45e0-9f61-27c15620ad0c nodeName:}" failed. No retries permitted until 2026-06-02 21:44:03.472216744 +0000 UTC m=+162.870947583 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls") pod "dns-default-jl288" (UID: "2773cab1-6497-45e0-9f61-27c15620ad0c") : secret "dns-default-metrics-tls" not found Jun 02 21:42:59.472335 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:42:59.472254 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert podName:7db682da-cedd-4e2b-9880-cc2ed25ab154 nodeName:}" failed. No retries permitted until 2026-06-02 21:44:03.472245823 +0000 UTC m=+162.870976656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert") pod "ingress-canary-nt5bn" (UID: "7db682da-cedd-4e2b-9880-cc2ed25ab154") : secret "canary-serving-cert" not found Jun 02 21:43:02.394554 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:02.394523 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lcfdg" Jun 02 21:43:18.256731 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.256700 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8"] Jun 02 21:43:18.259519 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.259503 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.261803 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.261780 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 21:43:18.264198 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.264157 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 21:43:18.264340 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.264322 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xdg7p\"" Jun 02 21:43:18.264416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.264399 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 21:43:18.265345 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.265325 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 21:43:18.265569 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.265552 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-hk5tw"] Jun 02 21:43:18.267280 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.267262 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84c4d7b6d5-nxmpw"] Jun 02 21:43:18.267415 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.267400 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.269242 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.269224 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.269968 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.269940 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 21:43:18.270247 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.270230 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 21:43:18.270947 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.270885 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 21:43:18.271814 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.271293 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 21:43:18.271814 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.271316 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9l69k\"" Jun 02 21:43:18.272381 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.272362 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 21:43:18.272548 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.272364 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 21:43:18.274329 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.274307 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 21:43:18.274507 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.274465 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-c5hkz\"" Jun 02 21:43:18.274576 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.274504 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 21:43:18.274630 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.274480 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 21:43:18.274851 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.274826 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 21:43:18.276685 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.276666 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8"] Jun 02 21:43:18.278231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.278212 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-hk5tw"] Jun 02 21:43:18.279552 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.279530 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 21:43:18.301503 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.301475 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84c4d7b6d5-nxmpw"] Jun 02 21:43:18.400066 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb905274-b12f-4db1-b055-653cef8f4162-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.400264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400086 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1836e217-5ee9-4b11-8192-01bf98207a5e-snapshots\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.400264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1836e217-5ee9-4b11-8192-01bf98207a5e-service-ca-bundle\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.400264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-default-certificate\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.400264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hjl\" (UniqueName: \"kubernetes.io/projected/bb905274-b12f-4db1-b055-653cef8f4162-kube-api-access-78hjl\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.400264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.400264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400261 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-stats-auth\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfc9l\" (UniqueName: \"kubernetes.io/projected/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-kube-api-access-jfc9l\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1836e217-5ee9-4b11-8192-01bf98207a5e-serving-cert\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssh6\" (UniqueName: \"kubernetes.io/projected/1836e217-5ee9-4b11-8192-01bf98207a5e-kube-api-access-jssh6\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1836e217-5ee9-4b11-8192-01bf98207a5e-tmp\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.400502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.400468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1836e217-5ee9-4b11-8192-01bf98207a5e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.500915 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.500884 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfc9l\" (UniqueName: \"kubernetes.io/projected/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-kube-api-access-jfc9l\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.500915 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.500919 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.501137 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.500954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1836e217-5ee9-4b11-8192-01bf98207a5e-serving-cert\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.501137 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.500973 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jssh6\" (UniqueName: \"kubernetes.io/projected/1836e217-5ee9-4b11-8192-01bf98207a5e-kube-api-access-jssh6\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.501137 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501004 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1836e217-5ee9-4b11-8192-01bf98207a5e-tmp\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.501137 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501021 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1836e217-5ee9-4b11-8192-01bf98207a5e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.501137 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501042 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb905274-b12f-4db1-b055-653cef8f4162-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.501137 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:18.501066 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:19.001048986 +0000 UTC m=+118.399779844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : configmap references non-existent config key: service-ca.crt Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501138 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1836e217-5ee9-4b11-8192-01bf98207a5e-snapshots\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501190 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1836e217-5ee9-4b11-8192-01bf98207a5e-service-ca-bundle\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501224 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-default-certificate\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501260 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78hjl\" (UniqueName: \"kubernetes.io/projected/bb905274-b12f-4db1-b055-653cef8f4162-kube-api-access-78hjl\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501309 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501340 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-stats-auth\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.501474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501367 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.501848 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:18.501483 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:18.501848 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:18.501537 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls podName:bb905274-b12f-4db1-b055-653cef8f4162 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:19.001516674 +0000 UTC m=+118.400247509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-t4rm8" (UID: "bb905274-b12f-4db1-b055-653cef8f4162") : secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:18.501848 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:18.501610 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 21:43:18.501848 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:18.501648 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:19.001633077 +0000 UTC m=+118.400363910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : secret "router-metrics-certs-default" not found Jun 02 21:43:18.501848 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1836e217-5ee9-4b11-8192-01bf98207a5e-tmp\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.502100 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501864 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1836e217-5ee9-4b11-8192-01bf98207a5e-snapshots\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.502100 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.501887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1836e217-5ee9-4b11-8192-01bf98207a5e-service-ca-bundle\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.502640 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.502613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bb905274-b12f-4db1-b055-653cef8f4162-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.502751 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.502726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1836e217-5ee9-4b11-8192-01bf98207a5e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.504257 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.504237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-stats-auth\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.504321 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.504237 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-default-certificate\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.504499 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.504483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1836e217-5ee9-4b11-8192-01bf98207a5e-serving-cert\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.512507 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.512440 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hjl\" (UniqueName: \"kubernetes.io/projected/bb905274-b12f-4db1-b055-653cef8f4162-kube-api-access-78hjl\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:18.512644 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.512623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssh6\" (UniqueName: \"kubernetes.io/projected/1836e217-5ee9-4b11-8192-01bf98207a5e-kube-api-access-jssh6\") pod \"insights-operator-788bf58df5-hk5tw\" (UID: \"1836e217-5ee9-4b11-8192-01bf98207a5e\") " pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.512706 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.512667 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfc9l\" (UniqueName: \"kubernetes.io/projected/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-kube-api-access-jfc9l\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:18.579702 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.579668 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" Jun 02 21:43:18.697988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:18.697956 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-hk5tw"] Jun 02 21:43:18.701437 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:18.701414 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1836e217_5ee9_4b11_8192_01bf98207a5e.slice/crio-63eceba46738eca0ec8301c19617e8af17f21841adba14a8aae569e065c31d88 WatchSource:0}: Error finding container 63eceba46738eca0ec8301c19617e8af17f21841adba14a8aae569e065c31d88: Status 404 returned error can't find the container with id 63eceba46738eca0ec8301c19617e8af17f21841adba14a8aae569e065c31d88 Jun 02 21:43:19.006328 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.006294 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:19.006523 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.006338 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:19.006523 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.006452 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:19.006523 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:19.006471 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 21:43:19.006682 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:19.006537 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:19.006682 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:19.006562 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:20.006540204 +0000 UTC m=+119.405271048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : secret "router-metrics-certs-default" not found Jun 02 21:43:19.006682 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:19.006589 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls podName:bb905274-b12f-4db1-b055-653cef8f4162 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:20.006575061 +0000 UTC m=+119.405305893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-t4rm8" (UID: "bb905274-b12f-4db1-b055-653cef8f4162") : secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:19.006682 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:19.006604 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:20.006597643 +0000 UTC m=+119.405328475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : configmap references non-existent config key: service-ca.crt Jun 02 21:43:19.210860 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.210825 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp"] Jun 02 21:43:19.213735 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.213718 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" Jun 02 21:43:19.217108 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.217076 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 21:43:19.217564 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.217548 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:43:19.217642 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.217549 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vkcrw\"" Jun 02 21:43:19.225369 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.225349 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp"] Jun 02 21:43:19.308063 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.307970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mffw\" (UniqueName: \"kubernetes.io/projected/14d9edf4-db7b-46f6-a2ec-271c83c89208-kube-api-access-6mffw\") pod \"volume-data-source-validator-7598fd5bd-s2bgp\" (UID: \"14d9edf4-db7b-46f6-a2ec-271c83c89208\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" Jun 02 21:43:19.409021 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.408980 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mffw\" (UniqueName: \"kubernetes.io/projected/14d9edf4-db7b-46f6-a2ec-271c83c89208-kube-api-access-6mffw\") pod \"volume-data-source-validator-7598fd5bd-s2bgp\" (UID: \"14d9edf4-db7b-46f6-a2ec-271c83c89208\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" Jun 02 21:43:19.417660 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.417635 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mffw\" (UniqueName: \"kubernetes.io/projected/14d9edf4-db7b-46f6-a2ec-271c83c89208-kube-api-access-6mffw\") pod \"volume-data-source-validator-7598fd5bd-s2bgp\" (UID: \"14d9edf4-db7b-46f6-a2ec-271c83c89208\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" Jun 02 21:43:19.475342 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.475302 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" event={"ID":"1836e217-5ee9-4b11-8192-01bf98207a5e","Type":"ContainerStarted","Data":"63eceba46738eca0ec8301c19617e8af17f21841adba14a8aae569e065c31d88"} Jun 02 21:43:19.522341 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.522298 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" Jun 02 21:43:19.648683 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:19.648650 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp"] Jun 02 21:43:19.651801 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:19.651771 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14d9edf4_db7b_46f6_a2ec_271c83c89208.slice/crio-4feb9864ccfede234d0ce8a50b598b680996d3e36ff299a5224254a54145ef39 WatchSource:0}: Error finding container 4feb9864ccfede234d0ce8a50b598b680996d3e36ff299a5224254a54145ef39: Status 404 returned error can't find the container with id 4feb9864ccfede234d0ce8a50b598b680996d3e36ff299a5224254a54145ef39 Jun 02 21:43:20.016847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:20.016811 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:20.016847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:20.016849 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:20.017080 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:20.016875 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:20.017080 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:20.016973 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:20.017080 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:20.016993 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:22.016980365 +0000 UTC m=+121.415711198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : configmap references non-existent config key: service-ca.crt Jun 02 21:43:20.017080 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:20.017024 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls podName:bb905274-b12f-4db1-b055-653cef8f4162 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:22.017011798 +0000 UTC m=+121.415742630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-t4rm8" (UID: "bb905274-b12f-4db1-b055-653cef8f4162") : secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:20.017080 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:20.017043 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 21:43:20.017303 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:20.017104 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:22.017087081 +0000 UTC m=+121.415817924 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : secret "router-metrics-certs-default" not found Jun 02 21:43:20.478935 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:20.478847 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" event={"ID":"14d9edf4-db7b-46f6-a2ec-271c83c89208","Type":"ContainerStarted","Data":"4feb9864ccfede234d0ce8a50b598b680996d3e36ff299a5224254a54145ef39"} Jun 02 21:43:21.230781 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.230751 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-f5jfk"] Jun 02 21:43:21.232679 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.232660 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.236344 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.236305 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nn8zq\"" Jun 02 21:43:21.236344 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.236335 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 21:43:21.236565 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.236549 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 21:43:21.236626 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.236606 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 21:43:21.236699 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.236680 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:43:21.244777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.244747 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 21:43:21.246660 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.246638 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-f5jfk"] Jun 02 21:43:21.328794 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.328691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-serving-cert\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.328794 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.328753 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-config\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.328794 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.328791 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-trusted-ca\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.329011 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.328811 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvhdp\" (UniqueName: \"kubernetes.io/projected/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-kube-api-access-pvhdp\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.429204 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.429139 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-serving-cert\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.429204 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.429217 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-config\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.429433 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.429253 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-trusted-ca\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.429433 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.429270 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvhdp\" (UniqueName: \"kubernetes.io/projected/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-kube-api-access-pvhdp\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.429963 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.429939 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-config\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.430178 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.430140 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-trusted-ca\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.431400 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.431381 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-serving-cert\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.438150 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.438128 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvhdp\" (UniqueName: \"kubernetes.io/projected/3f7c38e8-5dfc-4627-bb00-4b318c4a936c-kube-api-access-pvhdp\") pod \"console-operator-86d7c6cc77-f5jfk\" (UID: \"3f7c38e8-5dfc-4627-bb00-4b318c4a936c\") " pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.482640 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.482612 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" event={"ID":"1836e217-5ee9-4b11-8192-01bf98207a5e","Type":"ContainerStarted","Data":"39cb793d83fa9c92279d6783def6819b8d710cb21b02b81b3ff4d0d9a546ce4d"} Jun 02 21:43:21.483904 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.483882 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" event={"ID":"14d9edf4-db7b-46f6-a2ec-271c83c89208","Type":"ContainerStarted","Data":"cfa7ac269fec1a898e0129923deb14351f30cf3e79afe55402e214002fb0e3df"} Jun 02 21:43:21.499718 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.499669 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" podStartSLOduration=1.149050104 podStartE2EDuration="3.499652317s" podCreationTimestamp="2026-06-02 21:43:18 +0000 UTC" firstStartedPulling="2026-06-02 21:43:18.703026418 +0000 UTC m=+118.101757254" lastFinishedPulling="2026-06-02 21:43:21.053628632 +0000 UTC m=+120.452359467" observedRunningTime="2026-06-02 21:43:21.498857158 +0000 UTC m=+120.897588014" watchObservedRunningTime="2026-06-02 21:43:21.499652317 +0000 UTC m=+120.898383174" Jun 02 21:43:21.517409 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.517357 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-s2bgp" podStartSLOduration=1.092776285 podStartE2EDuration="2.517339445s" podCreationTimestamp="2026-06-02 21:43:19 +0000 UTC" firstStartedPulling="2026-06-02 21:43:19.653638952 +0000 UTC m=+119.052369799" lastFinishedPulling="2026-06-02 21:43:21.078202123 +0000 UTC m=+120.476932959" observedRunningTime="2026-06-02 21:43:21.515679534 +0000 UTC m=+120.914410383" watchObservedRunningTime="2026-06-02 21:43:21.517339445 +0000 UTC m=+120.916070303" Jun 02 21:43:21.545688 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.545664 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:21.669202 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:21.669150 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-f5jfk"] Jun 02 21:43:21.672289 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:21.672265 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f7c38e8_5dfc_4627_bb00_4b318c4a936c.slice/crio-1612582d1a244e749eca7329bdc8415fd223227cc994602ca04efde0730caaf9 WatchSource:0}: Error finding container 1612582d1a244e749eca7329bdc8415fd223227cc994602ca04efde0730caaf9: Status 404 returned error can't find the container with id 1612582d1a244e749eca7329bdc8415fd223227cc994602ca04efde0730caaf9 Jun 02 21:43:22.035961 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:22.035910 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:22.035961 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:22.035954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:22.036234 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:22.036078 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 21:43:22.036234 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:22.036087 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:22.036234 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:22.036151 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:26.036133028 +0000 UTC m=+125.434863885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : secret "router-metrics-certs-default" not found Jun 02 21:43:22.036234 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:22.036213 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:22.036234 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:22.036216 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:26.036186805 +0000 UTC m=+125.434917645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : configmap references non-existent config key: service-ca.crt Jun 02 21:43:22.036531 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:22.036262 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls podName:bb905274-b12f-4db1-b055-653cef8f4162 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:26.036248268 +0000 UTC m=+125.434979101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-t4rm8" (UID: "bb905274-b12f-4db1-b055-653cef8f4162") : secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:22.487416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:22.487326 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" event={"ID":"3f7c38e8-5dfc-4627-bb00-4b318c4a936c","Type":"ContainerStarted","Data":"1612582d1a244e749eca7329bdc8415fd223227cc994602ca04efde0730caaf9"} Jun 02 21:43:24.143038 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:24.143010 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dr9pl_1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63/dns-node-resolver/0.log" Jun 02 21:43:24.491814 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:24.491792 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/0.log" Jun 02 21:43:24.491957 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:24.491828 2565 generic.go:358] "Generic (PLEG): container finished" podID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" containerID="ad9886d4a54a359806749a4791090d5df133b77c47aed467ae5dea7c6000c403" exitCode=255 Jun 02 21:43:24.491957 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:24.491880 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" event={"ID":"3f7c38e8-5dfc-4627-bb00-4b318c4a936c","Type":"ContainerDied","Data":"ad9886d4a54a359806749a4791090d5df133b77c47aed467ae5dea7c6000c403"} Jun 02 21:43:24.492131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:24.492115 2565 scope.go:117] "RemoveContainer" containerID="ad9886d4a54a359806749a4791090d5df133b77c47aed467ae5dea7c6000c403" Jun 02 21:43:24.961658 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:24.961581 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mcvs8_c6dc3e32-7f48-46a0-be9f-518cdd0243e2/node-ca/0.log" Jun 02 21:43:25.495926 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:25.495899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/1.log" Jun 02 21:43:25.496384 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:25.496291 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/0.log" Jun 02 21:43:25.496384 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:25.496334 2565 generic.go:358] "Generic (PLEG): container finished" podID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" containerID="cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43" exitCode=255 Jun 02 21:43:25.496497 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:25.496405 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" event={"ID":"3f7c38e8-5dfc-4627-bb00-4b318c4a936c","Type":"ContainerDied","Data":"cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43"} Jun 02 21:43:25.496497 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:25.496446 2565 scope.go:117] "RemoveContainer" containerID="ad9886d4a54a359806749a4791090d5df133b77c47aed467ae5dea7c6000c403" Jun 02 21:43:25.496635 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:25.496617 2565 scope.go:117] "RemoveContainer" containerID="cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43" Jun 02 21:43:25.496845 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:25.496828 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-f5jfk_openshift-console-operator(3f7c38e8-5dfc-4627-bb00-4b318c4a936c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podUID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" Jun 02 21:43:26.071147 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:26.071115 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:26.071332 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:26.071225 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:26.071332 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:26.071246 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:26.071332 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:26.071287 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:34.071267586 +0000 UTC m=+133.469998424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : configmap references non-existent config key: service-ca.crt Jun 02 21:43:26.071457 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:26.071344 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:26.071457 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:26.071358 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 21:43:26.071457 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:26.071385 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls podName:bb905274-b12f-4db1-b055-653cef8f4162 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:34.071370692 +0000 UTC m=+133.470101526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-t4rm8" (UID: "bb905274-b12f-4db1-b055-653cef8f4162") : secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:26.071457 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:26.071401 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:34.071394001 +0000 UTC m=+133.470124834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : secret "router-metrics-certs-default" not found Jun 02 21:43:26.499752 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:26.499729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/1.log" Jun 02 21:43:26.500096 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:26.500042 2565 scope.go:117] "RemoveContainer" containerID="cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43" Jun 02 21:43:26.500240 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:26.500221 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-f5jfk_openshift-console-operator(3f7c38e8-5dfc-4627-bb00-4b318c4a936c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podUID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" Jun 02 21:43:27.224272 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.224239 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl"] Jun 02 21:43:27.228190 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.228158 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.230391 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.230370 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 21:43:27.230507 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.230403 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 21:43:27.231146 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.231125 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-cjcnj\"" Jun 02 21:43:27.231269 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.231173 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 21:43:27.231269 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.231149 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:43:27.234259 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.234229 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl"] Jun 02 21:43:27.287284 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.287260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3f788e4-9d3f-4305-bf7f-82e27d69e891-config\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.287429 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.287345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wfj\" (UniqueName: \"kubernetes.io/projected/c3f788e4-9d3f-4305-bf7f-82e27d69e891-kube-api-access-k6wfj\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.287482 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.287425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3f788e4-9d3f-4305-bf7f-82e27d69e891-serving-cert\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.388124 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.388095 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wfj\" (UniqueName: \"kubernetes.io/projected/c3f788e4-9d3f-4305-bf7f-82e27d69e891-kube-api-access-k6wfj\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.388288 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.388134 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3f788e4-9d3f-4305-bf7f-82e27d69e891-serving-cert\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.388288 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.388224 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3f788e4-9d3f-4305-bf7f-82e27d69e891-config\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.388670 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.388651 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3f788e4-9d3f-4305-bf7f-82e27d69e891-config\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.390273 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.390245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3f788e4-9d3f-4305-bf7f-82e27d69e891-serving-cert\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.397395 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.397377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wfj\" (UniqueName: \"kubernetes.io/projected/c3f788e4-9d3f-4305-bf7f-82e27d69e891-kube-api-access-k6wfj\") pod \"service-ca-operator-69877444c-6qlzl\" (UID: \"c3f788e4-9d3f-4305-bf7f-82e27d69e891\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.537137 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.537108 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" Jun 02 21:43:27.651736 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:27.651704 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl"] Jun 02 21:43:27.655232 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:27.655203 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f788e4_9d3f_4305_bf7f_82e27d69e891.slice/crio-731e3d4a7095916c4fb9e300533b8e3ab17846bba2592c4a8a4d47bff9b0aaeb WatchSource:0}: Error finding container 731e3d4a7095916c4fb9e300533b8e3ab17846bba2592c4a8a4d47bff9b0aaeb: Status 404 returned error can't find the container with id 731e3d4a7095916c4fb9e300533b8e3ab17846bba2592c4a8a4d47bff9b0aaeb Jun 02 21:43:28.507130 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:28.507096 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" event={"ID":"c3f788e4-9d3f-4305-bf7f-82e27d69e891","Type":"ContainerStarted","Data":"731e3d4a7095916c4fb9e300533b8e3ab17846bba2592c4a8a4d47bff9b0aaeb"} Jun 02 21:43:29.908221 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:29.908183 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:43:29.908656 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:29.908291 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 21:43:29.908656 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:29.908375 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs podName:32df7e35-cd92-413d-8b1d-7e671a424340 nodeName:}" failed. No retries permitted until 2026-06-02 21:45:31.908350669 +0000 UTC m=+251.307081509 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs") pod "network-metrics-daemon-ss85j" (UID: "32df7e35-cd92-413d-8b1d-7e671a424340") : secret "metrics-daemon-secret" not found Jun 02 21:43:30.514320 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:30.514287 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" event={"ID":"c3f788e4-9d3f-4305-bf7f-82e27d69e891","Type":"ContainerStarted","Data":"56b4c20f31b3da3cf14cb474162a496654a7ff081ffd2767933ae9bbc590e193"} Jun 02 21:43:30.530080 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:30.530028 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" podStartSLOduration=1.498038672 podStartE2EDuration="3.530012139s" podCreationTimestamp="2026-06-02 21:43:27 +0000 UTC" firstStartedPulling="2026-06-02 21:43:27.657004024 +0000 UTC m=+127.055734857" lastFinishedPulling="2026-06-02 21:43:29.688977473 +0000 UTC m=+129.087708324" observedRunningTime="2026-06-02 21:43:30.528693304 +0000 UTC m=+129.927424160" watchObservedRunningTime="2026-06-02 21:43:30.530012139 +0000 UTC m=+129.928742997" Jun 02 21:43:31.545997 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:31.545957 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:31.545997 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:31.545992 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:31.546420 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:31.546365 2565 scope.go:117] "RemoveContainer" containerID="cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43" Jun 02 21:43:31.546546 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:31.546528 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-f5jfk_openshift-console-operator(3f7c38e8-5dfc-4627-bb00-4b318c4a936c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podUID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" Jun 02 21:43:33.314421 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.314388 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-7jj52"] Jun 02 21:43:33.317469 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.317454 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.319839 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.319815 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 21:43:33.319839 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.319817 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 21:43:33.320046 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.319915 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 21:43:33.320593 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.320574 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vd2sk\"" Jun 02 21:43:33.320689 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.320599 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 21:43:33.324618 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.324597 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-7jj52"] Jun 02 21:43:33.436484 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.436441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acf3361b-1b6d-4b00-aaaf-c97c383432d5-signing-cabundle\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.436484 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.436483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nz2c\" (UniqueName: \"kubernetes.io/projected/acf3361b-1b6d-4b00-aaaf-c97c383432d5-kube-api-access-2nz2c\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.436690 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.436598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acf3361b-1b6d-4b00-aaaf-c97c383432d5-signing-key\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.537668 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.537637 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acf3361b-1b6d-4b00-aaaf-c97c383432d5-signing-key\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.537864 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.537711 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acf3361b-1b6d-4b00-aaaf-c97c383432d5-signing-cabundle\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.537864 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.537740 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nz2c\" (UniqueName: \"kubernetes.io/projected/acf3361b-1b6d-4b00-aaaf-c97c383432d5-kube-api-access-2nz2c\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.538442 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.538417 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acf3361b-1b6d-4b00-aaaf-c97c383432d5-signing-cabundle\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.539948 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.539926 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acf3361b-1b6d-4b00-aaaf-c97c383432d5-signing-key\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.545929 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.545905 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nz2c\" (UniqueName: \"kubernetes.io/projected/acf3361b-1b6d-4b00-aaaf-c97c383432d5-kube-api-access-2nz2c\") pod \"service-ca-685df94d57-7jj52\" (UID: \"acf3361b-1b6d-4b00-aaaf-c97c383432d5\") " pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.626906 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.626824 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-7jj52" Jun 02 21:43:33.748905 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:33.748874 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-7jj52"] Jun 02 21:43:33.752267 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:33.752237 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf3361b_1b6d_4b00_aaaf_c97c383432d5.slice/crio-b0557462f15a484a53506706bc1a4e55b4830dbc3d1dfc77c2ccdce347e86769 WatchSource:0}: Error finding container b0557462f15a484a53506706bc1a4e55b4830dbc3d1dfc77c2ccdce347e86769: Status 404 returned error can't find the container with id b0557462f15a484a53506706bc1a4e55b4830dbc3d1dfc77c2ccdce347e86769 Jun 02 21:43:34.146333 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:34.146290 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:34.146505 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:34.146341 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:34.146505 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:34.146389 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:34.146505 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:34.146454 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 21:43:34.146505 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:34.146455 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:34.146666 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:34.146510 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:50.146491675 +0000 UTC m=+149.545222509 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : configmap references non-existent config key: service-ca.crt Jun 02 21:43:34.146666 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:34.146529 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs podName:29ed9a93-37a0-4e48-bc78-f3f706cb9ade nodeName:}" failed. No retries permitted until 2026-06-02 21:43:50.146520121 +0000 UTC m=+149.545250960 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs") pod "router-default-84c4d7b6d5-nxmpw" (UID: "29ed9a93-37a0-4e48-bc78-f3f706cb9ade") : secret "router-metrics-certs-default" not found Jun 02 21:43:34.146666 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:34.146541 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls podName:bb905274-b12f-4db1-b055-653cef8f4162 nodeName:}" failed. No retries permitted until 2026-06-02 21:43:50.146534801 +0000 UTC m=+149.545265636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-t4rm8" (UID: "bb905274-b12f-4db1-b055-653cef8f4162") : secret "cluster-monitoring-operator-tls" not found Jun 02 21:43:34.525640 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:34.525600 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-7jj52" event={"ID":"acf3361b-1b6d-4b00-aaaf-c97c383432d5","Type":"ContainerStarted","Data":"fef8a212d586d1709c1d99576e6b45e70bc20ad865d02a5ba6284ce2add378e0"} Jun 02 21:43:34.525640 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:34.525644 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-7jj52" event={"ID":"acf3361b-1b6d-4b00-aaaf-c97c383432d5","Type":"ContainerStarted","Data":"b0557462f15a484a53506706bc1a4e55b4830dbc3d1dfc77c2ccdce347e86769"} Jun 02 21:43:34.550016 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:34.549965 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-7jj52" podStartSLOduration=1.54994779 podStartE2EDuration="1.54994779s" podCreationTimestamp="2026-06-02 21:43:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:34.54934247 +0000 UTC m=+133.948073324" watchObservedRunningTime="2026-06-02 21:43:34.54994779 +0000 UTC m=+133.948678646" Jun 02 21:43:46.104221 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.104190 2565 scope.go:117] "RemoveContainer" containerID="cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43" Jun 02 21:43:46.558090 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.558063 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:43:46.558437 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.558423 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/1.log" Jun 02 21:43:46.558495 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.558455 2565 generic.go:358] "Generic (PLEG): container finished" podID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" containerID="858a472c2a2d31b92cbf4aa5a505a02988de98dfebab22b5b4c321ecfc4bc6b5" exitCode=255 Jun 02 21:43:46.558495 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.558487 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" event={"ID":"3f7c38e8-5dfc-4627-bb00-4b318c4a936c","Type":"ContainerDied","Data":"858a472c2a2d31b92cbf4aa5a505a02988de98dfebab22b5b4c321ecfc4bc6b5"} Jun 02 21:43:46.558565 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.558519 2565 scope.go:117] "RemoveContainer" containerID="cb0bd400654c5eb480f13c63ce178290a7a7b0c0d873d72dd6f69b7d4c4bdc43" Jun 02 21:43:46.558857 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:46.558829 2565 scope.go:117] "RemoveContainer" containerID="858a472c2a2d31b92cbf4aa5a505a02988de98dfebab22b5b4c321ecfc4bc6b5" Jun 02 21:43:46.559010 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:46.558990 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-f5jfk_openshift-console-operator(3f7c38e8-5dfc-4627-bb00-4b318c4a936c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podUID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" Jun 02 21:43:47.562474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:47.562447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:43:50.179913 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.179860 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:50.179913 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.179920 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:50.180410 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.179962 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:50.180637 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.180613 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-service-ca-bundle\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:50.182243 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.182225 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29ed9a93-37a0-4e48-bc78-f3f706cb9ade-metrics-certs\") pod \"router-default-84c4d7b6d5-nxmpw\" (UID: \"29ed9a93-37a0-4e48-bc78-f3f706cb9ade\") " pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:50.182376 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.182359 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bb905274-b12f-4db1-b055-653cef8f4162-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-t4rm8\" (UID: \"bb905274-b12f-4db1-b055-653cef8f4162\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:50.371003 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.370975 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xdg7p\"" Jun 02 21:43:50.379639 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.379617 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" Jun 02 21:43:50.387658 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.387637 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-c5hkz\"" Jun 02 21:43:50.395644 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.395615 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:50.507324 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.507186 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8"] Jun 02 21:43:50.509722 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:50.509682 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb905274_b12f_4db1_b055_653cef8f4162.slice/crio-73f3d16bc885178c183b222ec03954f90c94258378c05803495d2bf3735ca87b WatchSource:0}: Error finding container 73f3d16bc885178c183b222ec03954f90c94258378c05803495d2bf3735ca87b: Status 404 returned error can't find the container with id 73f3d16bc885178c183b222ec03954f90c94258378c05803495d2bf3735ca87b Jun 02 21:43:50.522818 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.522792 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84c4d7b6d5-nxmpw"] Jun 02 21:43:50.526263 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:50.526233 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ed9a93_37a0_4e48_bc78_f3f706cb9ade.slice/crio-785edcbd3541f3d6463b9fa0c53f0378ef143fe2da462ba6a1bcd5197f8a7ff0 WatchSource:0}: Error finding container 785edcbd3541f3d6463b9fa0c53f0378ef143fe2da462ba6a1bcd5197f8a7ff0: Status 404 returned error can't find the container with id 785edcbd3541f3d6463b9fa0c53f0378ef143fe2da462ba6a1bcd5197f8a7ff0 Jun 02 21:43:50.570974 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.570947 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" event={"ID":"29ed9a93-37a0-4e48-bc78-f3f706cb9ade","Type":"ContainerStarted","Data":"785edcbd3541f3d6463b9fa0c53f0378ef143fe2da462ba6a1bcd5197f8a7ff0"} Jun 02 21:43:50.571904 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:50.571883 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" event={"ID":"bb905274-b12f-4db1-b055-653cef8f4162","Type":"ContainerStarted","Data":"73f3d16bc885178c183b222ec03954f90c94258378c05803495d2bf3735ca87b"} Jun 02 21:43:51.546112 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:51.546078 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:51.546112 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:51.546120 2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:43:51.546642 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:51.546600 2565 scope.go:117] "RemoveContainer" containerID="858a472c2a2d31b92cbf4aa5a505a02988de98dfebab22b5b4c321ecfc4bc6b5" Jun 02 21:43:51.546818 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:51.546794 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-f5jfk_openshift-console-operator(3f7c38e8-5dfc-4627-bb00-4b318c4a936c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podUID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" Jun 02 21:43:51.575935 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:51.575905 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" event={"ID":"29ed9a93-37a0-4e48-bc78-f3f706cb9ade","Type":"ContainerStarted","Data":"7295c5163e5f95074c5446f0891929f059ec0c19ad0626ae33f07dfd951e6891"} Jun 02 21:43:51.596887 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:51.596842 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" podStartSLOduration=33.596828736 podStartE2EDuration="33.596828736s" podCreationTimestamp="2026-06-02 21:43:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:43:51.595655262 +0000 UTC m=+150.994386119" watchObservedRunningTime="2026-06-02 21:43:51.596828736 +0000 UTC m=+150.995559591" Jun 02 21:43:52.261292 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.261268 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz"] Jun 02 21:43:52.265300 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.265281 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.267423 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.267394 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 21:43:52.267488 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.267421 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 21:43:52.268271 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.268253 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-x7rkz\"" Jun 02 21:43:52.273982 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.273950 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz"] Jun 02 21:43:52.387335 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.387304 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j2nd4"] Jun 02 21:43:52.390714 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.390691 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.393211 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.393187 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 21:43:52.393211 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.393200 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbwlq\"" Jun 02 21:43:52.393427 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.393278 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 21:43:52.396736 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.396708 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:52.399002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.398977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3866eb94-6864-40c4-a117-6007118e0685-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-wkgfz\" (UID: \"3866eb94-6864-40c4-a117-6007118e0685\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.399115 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.399034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3866eb94-6864-40c4-a117-6007118e0685-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-wkgfz\" (UID: \"3866eb94-6864-40c4-a117-6007118e0685\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.399825 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.399778 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:52.402355 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.402334 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2nd4"] Jun 02 21:43:52.499865 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.499834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fq4j\" (UniqueName: \"kubernetes.io/projected/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-kube-api-access-2fq4j\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.500014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.499891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-crio-socket\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.500014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.499929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.500014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.499952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-data-volume\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.500014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.499985 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3866eb94-6864-40c4-a117-6007118e0685-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-wkgfz\" (UID: \"3866eb94-6864-40c4-a117-6007118e0685\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.500209 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.500054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.500209 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.500181 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3866eb94-6864-40c4-a117-6007118e0685-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-wkgfz\" (UID: \"3866eb94-6864-40c4-a117-6007118e0685\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.500576 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.500555 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3866eb94-6864-40c4-a117-6007118e0685-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-wkgfz\" (UID: \"3866eb94-6864-40c4-a117-6007118e0685\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.502556 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.502539 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3866eb94-6864-40c4-a117-6007118e0685-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-wkgfz\" (UID: \"3866eb94-6864-40c4-a117-6007118e0685\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.575205 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.575153 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" Jun 02 21:43:52.580260 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.580230 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" event={"ID":"bb905274-b12f-4db1-b055-653cef8f4162","Type":"ContainerStarted","Data":"6d1b0d79490508733cf34ff797c0c81efd5d22bb0dfb7950c7477aa5088590be"} Jun 02 21:43:52.580826 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.580790 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:52.582001 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.581983 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84c4d7b6d5-nxmpw" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.601501 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fq4j\" (UniqueName: \"kubernetes.io/projected/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-kube-api-access-2fq4j\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.601565 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-crio-socket\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.601609 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.601640 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-data-volume\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.601683 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.602290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.602599 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-crio-socket\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.602956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.602767 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-t4rm8" podStartSLOduration=32.894006598 podStartE2EDuration="34.602753274s" podCreationTimestamp="2026-06-02 21:43:18 +0000 UTC" firstStartedPulling="2026-06-02 21:43:50.511633277 +0000 UTC m=+149.910364110" lastFinishedPulling="2026-06-02 21:43:52.220379948 +0000 UTC m=+151.619110786" observedRunningTime="2026-06-02 21:43:52.600796327 +0000 UTC m=+151.999527180" watchObservedRunningTime="2026-06-02 21:43:52.602753274 +0000 UTC m=+152.001484131" Jun 02 21:43:52.603458 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.603200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-data-volume\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.617845 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.606527 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.620360 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.620337 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fq4j\" (UniqueName: \"kubernetes.io/projected/611e1c48-03e9-45e1-9c81-9ccaa260f5b7-kube-api-access-2fq4j\") pod \"insights-runtime-extractor-j2nd4\" (UID: \"611e1c48-03e9-45e1-9c81-9ccaa260f5b7\") " pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.701562 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.701518 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j2nd4" Jun 02 21:43:52.734080 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.734048 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz"] Jun 02 21:43:52.737465 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:52.737439 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3866eb94_6864_40c4_a117_6007118e0685.slice/crio-652d22290d757bb139517cbbe23a90653378944e391bab156ed91b07b2f90aa4 WatchSource:0}: Error finding container 652d22290d757bb139517cbbe23a90653378944e391bab156ed91b07b2f90aa4: Status 404 returned error can't find the container with id 652d22290d757bb139517cbbe23a90653378944e391bab156ed91b07b2f90aa4 Jun 02 21:43:52.841385 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:52.841346 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j2nd4"] Jun 02 21:43:52.843942 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:52.843916 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611e1c48_03e9_45e1_9c81_9ccaa260f5b7.slice/crio-027617e0996ca3a71a8b1f644e9054d691da23892b86b7145269f598ba91fcd9 WatchSource:0}: Error finding container 027617e0996ca3a71a8b1f644e9054d691da23892b86b7145269f598ba91fcd9: Status 404 returned error can't find the container with id 027617e0996ca3a71a8b1f644e9054d691da23892b86b7145269f598ba91fcd9 Jun 02 21:43:53.583876 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:53.583837 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" event={"ID":"3866eb94-6864-40c4-a117-6007118e0685","Type":"ContainerStarted","Data":"652d22290d757bb139517cbbe23a90653378944e391bab156ed91b07b2f90aa4"} Jun 02 21:43:53.586126 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:53.586102 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2nd4" event={"ID":"611e1c48-03e9-45e1-9c81-9ccaa260f5b7","Type":"ContainerStarted","Data":"9224a447937f7bdf469c2e55492e934d42047ea5c3182d06dc315bf028652689"} Jun 02 21:43:53.586251 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:53.586133 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2nd4" event={"ID":"611e1c48-03e9-45e1-9c81-9ccaa260f5b7","Type":"ContainerStarted","Data":"738ff17b441386adcc38eaeecc8048ec6c284480468dc871527d5d1eb02f2405"} Jun 02 21:43:53.586251 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:53.586145 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2nd4" event={"ID":"611e1c48-03e9-45e1-9c81-9ccaa260f5b7","Type":"ContainerStarted","Data":"027617e0996ca3a71a8b1f644e9054d691da23892b86b7145269f598ba91fcd9"} Jun 02 21:43:54.590551 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:54.590506 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" event={"ID":"3866eb94-6864-40c4-a117-6007118e0685","Type":"ContainerStarted","Data":"7aacff25622e45bedec56ec83f8a10379178f098ef3ba7727d28f0bd4fae592e"} Jun 02 21:43:54.606513 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:54.606467 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-wkgfz" podStartSLOduration=1.447186691 podStartE2EDuration="2.606452574s" podCreationTimestamp="2026-06-02 21:43:52 +0000 UTC" firstStartedPulling="2026-06-02 21:43:52.739531234 +0000 UTC m=+152.138262071" lastFinishedPulling="2026-06-02 21:43:53.89879712 +0000 UTC m=+153.297527954" observedRunningTime="2026-06-02 21:43:54.605178683 +0000 UTC m=+154.003909536" watchObservedRunningTime="2026-06-02 21:43:54.606452574 +0000 UTC m=+154.005183468" Jun 02 21:43:55.594535 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:55.594496 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j2nd4" event={"ID":"611e1c48-03e9-45e1-9c81-9ccaa260f5b7","Type":"ContainerStarted","Data":"97551f59dab6b485d722a4f6b2629d22151f9e6f937ec085cdc8542254f40931"} Jun 02 21:43:55.615893 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:55.615801 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j2nd4" podStartSLOduration=1.564048923 podStartE2EDuration="3.615784351s" podCreationTimestamp="2026-06-02 21:43:52 +0000 UTC" firstStartedPulling="2026-06-02 21:43:52.915113393 +0000 UTC m=+152.313844228" lastFinishedPulling="2026-06-02 21:43:54.966848823 +0000 UTC m=+154.365579656" observedRunningTime="2026-06-02 21:43:55.615291506 +0000 UTC m=+155.014022360" watchObservedRunningTime="2026-06-02 21:43:55.615784351 +0000 UTC m=+155.014515207" Jun 02 21:43:56.843779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.841481 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c"] Jun 02 21:43:56.845381 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.845350 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:56.847798 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.847775 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 21:43:56.847798 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.847797 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 21:43:56.848964 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.848946 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gvqpr\"" Jun 02 21:43:56.848964 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.848962 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 21:43:56.853285 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.853264 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c"] Jun 02 21:43:56.938677 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.938643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:56.938847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.938711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54mdn\" (UniqueName: \"kubernetes.io/projected/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-kube-api-access-54mdn\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:56.938847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.938800 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:56.938847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:56.938825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.040131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.040094 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54mdn\" (UniqueName: \"kubernetes.io/projected/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-kube-api-access-54mdn\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.040331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.040204 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.040331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.040231 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.040331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.040259 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.040845 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.040818 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.042547 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.042526 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.042701 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.042684 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.048637 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.048612 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54mdn\" (UniqueName: \"kubernetes.io/projected/fa61a124-dcc4-416f-ad6d-a51c4b5ba225-kube-api-access-54mdn\") pod \"prometheus-operator-658bcd8bdf-b7t6c\" (UID: \"fa61a124-dcc4-416f-ad6d-a51c4b5ba225\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.156465 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.156402 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" Jun 02 21:43:57.274953 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.274920 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c"] Jun 02 21:43:57.277843 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:43:57.277820 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa61a124_dcc4_416f_ad6d_a51c4b5ba225.slice/crio-cc41abb9f677218a7191a1353f81465bf9aad07adfa90653ad96450c1779d59d WatchSource:0}: Error finding container cc41abb9f677218a7191a1353f81465bf9aad07adfa90653ad96450c1779d59d: Status 404 returned error can't find the container with id cc41abb9f677218a7191a1353f81465bf9aad07adfa90653ad96450c1779d59d Jun 02 21:43:57.601139 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:57.601104 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" event={"ID":"fa61a124-dcc4-416f-ad6d-a51c4b5ba225","Type":"ContainerStarted","Data":"cc41abb9f677218a7191a1353f81465bf9aad07adfa90653ad96450c1779d59d"} Jun 02 21:43:58.506809 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:58.506769 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" podUID="9b49276d-9a26-444b-a804-290eb1404afe" Jun 02 21:43:58.525954 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:58.525915 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jl288" podUID="2773cab1-6497-45e0-9f61-27c15620ad0c" Jun 02 21:43:58.549095 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:58.549060 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-nt5bn" podUID="7db682da-cedd-4e2b-9880-cc2ed25ab154" Jun 02 21:43:58.603587 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:58.603566 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jl288" Jun 02 21:43:58.603706 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:58.603566 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:43:59.114978 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:43:59.114938 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ss85j" podUID="32df7e35-cd92-413d-8b1d-7e671a424340" Jun 02 21:43:59.607973 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:59.607931 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" event={"ID":"fa61a124-dcc4-416f-ad6d-a51c4b5ba225","Type":"ContainerStarted","Data":"2b442d56c43ad1fba86e940eef65835b13773c6739eda589de80cae348c1ca97"} Jun 02 21:43:59.607973 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:59.607972 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" event={"ID":"fa61a124-dcc4-416f-ad6d-a51c4b5ba225","Type":"ContainerStarted","Data":"46fd941a297b00a028353ebf958609099f10b2f84f0e75a6b17643614af40d97"} Jun 02 21:43:59.626351 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:43:59.626308 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-b7t6c" podStartSLOduration=2.314756179 podStartE2EDuration="3.626296566s" podCreationTimestamp="2026-06-02 21:43:56 +0000 UTC" firstStartedPulling="2026-06-02 21:43:57.279742228 +0000 UTC m=+156.678473060" lastFinishedPulling="2026-06-02 21:43:58.591282598 +0000 UTC m=+157.990013447" observedRunningTime="2026-06-02 21:43:59.625694035 +0000 UTC m=+159.024424889" watchObservedRunningTime="2026-06-02 21:43:59.626296566 +0000 UTC m=+159.025027459" Jun 02 21:44:01.226077 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.226044 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2"] Jun 02 21:44:01.232329 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.232303 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.234845 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.234822 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 21:44:01.235520 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.235495 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 21:44:01.235726 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.235708 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 21:44:01.235989 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.235781 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hx7r6\"" Jun 02 21:44:01.237632 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.237609 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zzcjp"] Jun 02 21:44:01.241392 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.241370 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.241499 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.241388 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2"] Jun 02 21:44:01.243423 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.243402 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 21:44:01.243575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.243555 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z7p22\"" Jun 02 21:44:01.243656 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.243636 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 21:44:01.244293 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.244272 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 21:44:01.377389 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.377592 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377592 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377592 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-textfile\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-tls\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-sys\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8678870-39cf-4a3b-8c6e-5faa56ccead1-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.377759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377709 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z88v\" (UniqueName: \"kubernetes.io/projected/c4592562-c746-46ee-9abd-37881388d2f7-kube-api-access-8z88v\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377759 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2pf8\" (UniqueName: \"kubernetes.io/projected/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-api-access-b2pf8\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.377988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e8678870-39cf-4a3b-8c6e-5faa56ccead1-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.377988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377806 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-wtmp\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4592562-c746-46ee-9abd-37881388d2f7-metrics-client-ca\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-root\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.377988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.377988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.377961 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.478873 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.478761 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4592562-c746-46ee-9abd-37881388d2f7-metrics-client-ca\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.478873 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.478844 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-root\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479094 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.478877 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479094 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.478909 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479094 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.478963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-root\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479094 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.478967 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479094 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479054 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479097 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479194 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-textfile\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479226 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-tls\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479262 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-sys\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479292 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8678870-39cf-4a3b-8c6e-5faa56ccead1-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479321 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8z88v\" (UniqueName: \"kubernetes.io/projected/c4592562-c746-46ee-9abd-37881388d2f7-kube-api-access-8z88v\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479354 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2pf8\" (UniqueName: \"kubernetes.io/projected/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-api-access-b2pf8\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479382 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e8678870-39cf-4a3b-8c6e-5faa56ccead1-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479412 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-wtmp\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479466 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479462 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-sys\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4592562-c746-46ee-9abd-37881388d2f7-metrics-client-ca\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479582 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-wtmp\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479709 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.479916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479736 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-textfile\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.479916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.479782 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e8678870-39cf-4a3b-8c6e-5faa56ccead1-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.480191 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.480139 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.480449 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.480425 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8678870-39cf-4a3b-8c6e-5faa56ccead1-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.481778 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.481756 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.482142 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.482111 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-tls\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.482315 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.482289 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.482562 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.482543 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4592562-c746-46ee-9abd-37881388d2f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.487056 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.487036 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z88v\" (UniqueName: \"kubernetes.io/projected/c4592562-c746-46ee-9abd-37881388d2f7-kube-api-access-8z88v\") pod \"node-exporter-zzcjp\" (UID: \"c4592562-c746-46ee-9abd-37881388d2f7\") " pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.487532 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.487513 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2pf8\" (UniqueName: \"kubernetes.io/projected/e8678870-39cf-4a3b-8c6e-5faa56ccead1-kube-api-access-b2pf8\") pod \"kube-state-metrics-8469c486bb-tcnm2\" (UID: \"e8678870-39cf-4a3b-8c6e-5faa56ccead1\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.543148 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.543107 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" Jun 02 21:44:01.552201 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.552157 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zzcjp" Jun 02 21:44:01.562137 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:01.562094 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4592562_c746_46ee_9abd_37881388d2f7.slice/crio-bc9b135520bc8424acd32c8064272c6af4c144730020c21fa3fb5c34efd5a0b4 WatchSource:0}: Error finding container bc9b135520bc8424acd32c8064272c6af4c144730020c21fa3fb5c34efd5a0b4: Status 404 returned error can't find the container with id bc9b135520bc8424acd32c8064272c6af4c144730020c21fa3fb5c34efd5a0b4 Jun 02 21:44:01.616214 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.616150 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzcjp" event={"ID":"c4592562-c746-46ee-9abd-37881388d2f7","Type":"ContainerStarted","Data":"bc9b135520bc8424acd32c8064272c6af4c144730020c21fa3fb5c34efd5a0b4"} Jun 02 21:44:01.705011 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:01.704989 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2"] Jun 02 21:44:01.706816 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:01.706791 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8678870_39cf_4a3b_8c6e_5faa56ccead1.slice/crio-a3f3d3678c70dc9c7eb24358a0403ad6ec4eb934179ab3b6e4b15c72bcbc997a WatchSource:0}: Error finding container a3f3d3678c70dc9c7eb24358a0403ad6ec4eb934179ab3b6e4b15c72bcbc997a: Status 404 returned error can't find the container with id a3f3d3678c70dc9c7eb24358a0403ad6ec4eb934179ab3b6e4b15c72bcbc997a Jun 02 21:44:02.621201 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:02.621131 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" event={"ID":"e8678870-39cf-4a3b-8c6e-5faa56ccead1","Type":"ContainerStarted","Data":"a3f3d3678c70dc9c7eb24358a0403ad6ec4eb934179ab3b6e4b15c72bcbc997a"} Jun 02 21:44:03.399831 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.399797 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:03.402440 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.402415 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"image-registry-769ff5485f-lwr8j\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:03.406479 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.406459 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtd5q\"" Jun 02 21:44:03.414399 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.414381 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:03.500300 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.500275 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:44:03.500915 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.500391 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:44:03.503236 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.503214 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2773cab1-6497-45e0-9f61-27c15620ad0c-metrics-tls\") pod \"dns-default-jl288\" (UID: \"2773cab1-6497-45e0-9f61-27c15620ad0c\") " pod="openshift-dns/dns-default-jl288" Jun 02 21:44:03.503430 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.503409 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db682da-cedd-4e2b-9880-cc2ed25ab154-cert\") pod \"ingress-canary-nt5bn\" (UID: \"7db682da-cedd-4e2b-9880-cc2ed25ab154\") " pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:44:03.551358 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.551318 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-769ff5485f-lwr8j"] Jun 02 21:44:03.554536 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:03.554502 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b49276d_9a26_444b_a804_290eb1404afe.slice/crio-7fb42c4adb6ce7d3da1718178e03e79ba9225ebb82e049aa9908403a42ff540a WatchSource:0}: Error finding container 7fb42c4adb6ce7d3da1718178e03e79ba9225ebb82e049aa9908403a42ff540a: Status 404 returned error can't find the container with id 7fb42c4adb6ce7d3da1718178e03e79ba9225ebb82e049aa9908403a42ff540a Jun 02 21:44:03.624653 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.624624 2565 generic.go:358] "Generic (PLEG): container finished" podID="c4592562-c746-46ee-9abd-37881388d2f7" containerID="27928a562d04f690c912b0f03d4c52e61e7af06fd4bde0e89498b297ad50937b" exitCode=0 Jun 02 21:44:03.625026 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.624713 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzcjp" event={"ID":"c4592562-c746-46ee-9abd-37881388d2f7","Type":"ContainerDied","Data":"27928a562d04f690c912b0f03d4c52e61e7af06fd4bde0e89498b297ad50937b"} Jun 02 21:44:03.626595 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.626571 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" event={"ID":"e8678870-39cf-4a3b-8c6e-5faa56ccead1","Type":"ContainerStarted","Data":"e289cef062c5b04bbed30b9b6e84076f276d9cd5601295d1e705afac4f8a80de"} Jun 02 21:44:03.626699 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.626602 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" event={"ID":"e8678870-39cf-4a3b-8c6e-5faa56ccead1","Type":"ContainerStarted","Data":"9d793df286047e9cd5dea6d1d4938d3274cfc743a9374faaefb4cd5ee75a351a"} Jun 02 21:44:03.626699 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.626615 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" event={"ID":"e8678870-39cf-4a3b-8c6e-5faa56ccead1","Type":"ContainerStarted","Data":"35339556b148745a290d0a4e3de58c5a919b9698853324a22a676292e203ae5d"} Jun 02 21:44:03.628072 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.628051 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" event={"ID":"9b49276d-9a26-444b-a804-290eb1404afe","Type":"ContainerStarted","Data":"4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780"} Jun 02 21:44:03.628148 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.628076 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" event={"ID":"9b49276d-9a26-444b-a804-290eb1404afe","Type":"ContainerStarted","Data":"7fb42c4adb6ce7d3da1718178e03e79ba9225ebb82e049aa9908403a42ff540a"} Jun 02 21:44:03.628250 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.628183 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:03.664326 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.664280 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tcnm2" podStartSLOduration=1.393230839 podStartE2EDuration="2.66426462s" podCreationTimestamp="2026-06-02 21:44:01 +0000 UTC" firstStartedPulling="2026-06-02 21:44:01.708749612 +0000 UTC m=+161.107480450" lastFinishedPulling="2026-06-02 21:44:02.979783394 +0000 UTC m=+162.378514231" observedRunningTime="2026-06-02 21:44:03.663587146 +0000 UTC m=+163.062318003" watchObservedRunningTime="2026-06-02 21:44:03.66426462 +0000 UTC m=+163.062995475" Jun 02 21:44:03.684521 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.684469 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" podStartSLOduration=162.684452412 podStartE2EDuration="2m42.684452412s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:44:03.68385178 +0000 UTC m=+163.082582635" watchObservedRunningTime="2026-06-02 21:44:03.684452412 +0000 UTC m=+163.083183269" Jun 02 21:44:03.705879 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.705855 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssb95\"" Jun 02 21:44:03.714636 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.714618 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jl288" Jun 02 21:44:03.849596 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:03.849561 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jl288"] Jun 02 21:44:03.852325 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:03.852297 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2773cab1_6497_45e0_9f61_27c15620ad0c.slice/crio-5f31bf19a09442c730261515b87a001f4700d69e426258014eeb5c5aa165e6e9 WatchSource:0}: Error finding container 5f31bf19a09442c730261515b87a001f4700d69e426258014eeb5c5aa165e6e9: Status 404 returned error can't find the container with id 5f31bf19a09442c730261515b87a001f4700d69e426258014eeb5c5aa165e6e9 Jun 02 21:44:04.634194 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:04.633913 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzcjp" event={"ID":"c4592562-c746-46ee-9abd-37881388d2f7","Type":"ContainerStarted","Data":"1e251d8a31191c01cebf542a3e6e8969e92734ec81680ecbd05ba254f4fd8bfe"} Jun 02 21:44:04.634194 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:04.633959 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zzcjp" event={"ID":"c4592562-c746-46ee-9abd-37881388d2f7","Type":"ContainerStarted","Data":"0145d68b574942e1c88018895ca7fc50c5f5ed9bcd1b834362926f00e749a1d7"} Jun 02 21:44:04.635844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:04.635805 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jl288" event={"ID":"2773cab1-6497-45e0-9f61-27c15620ad0c","Type":"ContainerStarted","Data":"5f31bf19a09442c730261515b87a001f4700d69e426258014eeb5c5aa165e6e9"} Jun 02 21:44:04.655902 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:04.655849 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zzcjp" podStartSLOduration=2.647568667 podStartE2EDuration="3.655832094s" podCreationTimestamp="2026-06-02 21:44:01 +0000 UTC" firstStartedPulling="2026-06-02 21:44:01.564572333 +0000 UTC m=+160.963303173" lastFinishedPulling="2026-06-02 21:44:02.572835753 +0000 UTC m=+161.971566600" observedRunningTime="2026-06-02 21:44:04.655096948 +0000 UTC m=+164.053827804" watchObservedRunningTime="2026-06-02 21:44:04.655832094 +0000 UTC m=+164.054562951" Jun 02 21:44:05.104288 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.104251 2565 scope.go:117] "RemoveContainer" containerID="858a472c2a2d31b92cbf4aa5a505a02988de98dfebab22b5b4c321ecfc4bc6b5" Jun 02 21:44:05.104492 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:44:05.104465 2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-f5jfk_openshift-console-operator(3f7c38e8-5dfc-4627-bb00-4b318c4a936c)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podUID="3f7c38e8-5dfc-4627-bb00-4b318c4a936c" Jun 02 21:44:05.640464 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.640376 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jl288" event={"ID":"2773cab1-6497-45e0-9f61-27c15620ad0c","Type":"ContainerStarted","Data":"8e86d10c12fa159d3d1aa6497929bd7ccaf9635c1489a145515b50455f00ace8"} Jun 02 21:44:05.640464 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.640416 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jl288" event={"ID":"2773cab1-6497-45e0-9f61-27c15620ad0c","Type":"ContainerStarted","Data":"dcd7a7d8b1abac8456b6e0159e335729dac99b0d894c62f98d1cbd945df4cc5e"} Jun 02 21:44:05.640832 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.640610 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jl288" Jun 02 21:44:05.656784 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.656732 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jl288" podStartSLOduration=129.312142911 podStartE2EDuration="2m10.656715104s" podCreationTimestamp="2026-06-02 21:41:55 +0000 UTC" firstStartedPulling="2026-06-02 21:44:03.854146517 +0000 UTC m=+163.252877349" lastFinishedPulling="2026-06-02 21:44:05.19871871 +0000 UTC m=+164.597449542" observedRunningTime="2026-06-02 21:44:05.656346095 +0000 UTC m=+165.055076962" watchObservedRunningTime="2026-06-02 21:44:05.656715104 +0000 UTC m=+165.055445960" Jun 02 21:44:05.968925 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.968846 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl"] Jun 02 21:44:05.971135 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.971111 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:05.974543 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.974518 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-lqxng\"" Jun 02 21:44:05.974543 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.974536 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 21:44:05.980061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:05.980015 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl"] Jun 02 21:44:06.026284 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.026252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/438e1b74-11c2-479d-b101-0d1b66852105-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7c6zl\" (UID: \"438e1b74-11c2-479d-b101-0d1b66852105\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:06.127456 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.127419 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/438e1b74-11c2-479d-b101-0d1b66852105-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7c6zl\" (UID: \"438e1b74-11c2-479d-b101-0d1b66852105\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:06.127633 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:44:06.127579 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 21:44:06.127691 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:44:06.127644 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438e1b74-11c2-479d-b101-0d1b66852105-monitoring-plugin-cert podName:438e1b74-11c2-479d-b101-0d1b66852105 nodeName:}" failed. No retries permitted until 2026-06-02 21:44:06.627625949 +0000 UTC m=+166.026356799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/438e1b74-11c2-479d-b101-0d1b66852105-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-7c6zl" (UID: "438e1b74-11c2-479d-b101-0d1b66852105") : secret "monitoring-plugin-cert" not found Jun 02 21:44:06.426570 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.426536 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-657f7c8cbf-55xp5"] Jun 02 21:44:06.429037 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.429015 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.431564 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.431542 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 21:44:06.431659 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.431540 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rrjzp\"" Jun 02 21:44:06.431659 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.431540 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 21:44:06.431750 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.431739 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 21:44:06.431811 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.431795 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 21:44:06.431873 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.431858 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 21:44:06.436225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.436203 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 21:44:06.443705 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.443684 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-657f7c8cbf-55xp5"] Jun 02 21:44:06.529966 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.529938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.529974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-secret-telemeter-client\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.530003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-serving-certs-ca-bundle\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.530021 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-telemeter-client-tls\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.530081 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-metrics-client-ca\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530350 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.530207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pj9n\" (UniqueName: \"kubernetes.io/projected/fee33acf-ec72-4270-b56a-93d9d177744d-kube-api-access-5pj9n\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530350 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.530274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-federate-client-tls\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.530350 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.530315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631404 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631369 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631515 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631418 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631515 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631443 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-secret-telemeter-client\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631515 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631463 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-serving-certs-ca-bundle\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631515 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631479 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-telemeter-client-tls\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631714 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631517 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-metrics-client-ca\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631714 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631661 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5pj9n\" (UniqueName: \"kubernetes.io/projected/fee33acf-ec72-4270-b56a-93d9d177744d-kube-api-access-5pj9n\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.631714 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631702 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/438e1b74-11c2-479d-b101-0d1b66852105-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7c6zl\" (UID: \"438e1b74-11c2-479d-b101-0d1b66852105\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:06.631850 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.631732 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-federate-client-tls\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.632275 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.632245 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-serving-certs-ca-bundle\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.632375 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.632333 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.632556 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.632530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fee33acf-ec72-4270-b56a-93d9d177744d-metrics-client-ca\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.634250 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.634227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-federate-client-tls\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.634250 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.634240 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-telemeter-client-tls\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.634569 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.634545 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.634569 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.634558 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/438e1b74-11c2-479d-b101-0d1b66852105-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-7c6zl\" (UID: \"438e1b74-11c2-479d-b101-0d1b66852105\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:06.634658 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.634600 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fee33acf-ec72-4270-b56a-93d9d177744d-secret-telemeter-client\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.639065 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.639049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pj9n\" (UniqueName: \"kubernetes.io/projected/fee33acf-ec72-4270-b56a-93d9d177744d-kube-api-access-5pj9n\") pod \"telemeter-client-657f7c8cbf-55xp5\" (UID: \"fee33acf-ec72-4270-b56a-93d9d177744d\") " pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.739919 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.739895 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" Jun 02 21:44:06.868726 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.868692 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-657f7c8cbf-55xp5"] Jun 02 21:44:06.872582 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:06.872554 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee33acf_ec72_4270_b56a_93d9d177744d.slice/crio-ad7f4c7dac0796c4ff51a059a23c128b4956a18cb23216faf44e7fb874c694fe WatchSource:0}: Error finding container ad7f4c7dac0796c4ff51a059a23c128b4956a18cb23216faf44e7fb874c694fe: Status 404 returned error can't find the container with id ad7f4c7dac0796c4ff51a059a23c128b4956a18cb23216faf44e7fb874c694fe Jun 02 21:44:06.880922 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.880898 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:06.999187 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:06.999130 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl"] Jun 02 21:44:07.001702 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:07.001679 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438e1b74_11c2_479d_b101_0d1b66852105.slice/crio-6935b67649fa025218f31601b615cc513c7d9e3fbe5bde1c53009b44fc76edc4 WatchSource:0}: Error finding container 6935b67649fa025218f31601b615cc513c7d9e3fbe5bde1c53009b44fc76edc4: Status 404 returned error can't find the container with id 6935b67649fa025218f31601b615cc513c7d9e3fbe5bde1c53009b44fc76edc4 Jun 02 21:44:07.648758 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:07.648713 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" event={"ID":"fee33acf-ec72-4270-b56a-93d9d177744d","Type":"ContainerStarted","Data":"ad7f4c7dac0796c4ff51a059a23c128b4956a18cb23216faf44e7fb874c694fe"} Jun 02 21:44:07.649985 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:07.649952 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" event={"ID":"438e1b74-11c2-479d-b101-0d1b66852105","Type":"ContainerStarted","Data":"6935b67649fa025218f31601b615cc513c7d9e3fbe5bde1c53009b44fc76edc4"} Jun 02 21:44:09.103581 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.103496 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:44:09.106549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.106527 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f7jrx\"" Jun 02 21:44:09.114627 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.114597 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nt5bn" Jun 02 21:44:09.259967 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.259919 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nt5bn"] Jun 02 21:44:09.263222 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:09.263188 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db682da_cedd_4e2b_9880_cc2ed25ab154.slice/crio-0863bc14fd75d8e53c0f16e8d05d41887e6738ee508a332b07c7f909125fbf98 WatchSource:0}: Error finding container 0863bc14fd75d8e53c0f16e8d05d41887e6738ee508a332b07c7f909125fbf98: Status 404 returned error can't find the container with id 0863bc14fd75d8e53c0f16e8d05d41887e6738ee508a332b07c7f909125fbf98 Jun 02 21:44:09.657650 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.657604 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" event={"ID":"fee33acf-ec72-4270-b56a-93d9d177744d","Type":"ContainerStarted","Data":"3f135d21eafd30c1320129b2be39b882f52e9a83bf2b4e86722611969e1234e5"} Jun 02 21:44:09.659068 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.659037 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" event={"ID":"438e1b74-11c2-479d-b101-0d1b66852105","Type":"ContainerStarted","Data":"99c59194139089b0b380489750d33744b1f6634c9b8e94730c1c53bf6c6dd45c"} Jun 02 21:44:09.659378 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.659349 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:09.660325 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.660299 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nt5bn" event={"ID":"7db682da-cedd-4e2b-9880-cc2ed25ab154","Type":"ContainerStarted","Data":"0863bc14fd75d8e53c0f16e8d05d41887e6738ee508a332b07c7f909125fbf98"} Jun 02 21:44:09.664292 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.664269 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" Jun 02 21:44:09.675169 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:09.675126 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-7c6zl" podStartSLOduration=2.858732755 podStartE2EDuration="4.675112465s" podCreationTimestamp="2026-06-02 21:44:05 +0000 UTC" firstStartedPulling="2026-06-02 21:44:07.00361034 +0000 UTC m=+166.402341173" lastFinishedPulling="2026-06-02 21:44:08.819990047 +0000 UTC m=+168.218720883" observedRunningTime="2026-06-02 21:44:09.673689356 +0000 UTC m=+169.072420210" watchObservedRunningTime="2026-06-02 21:44:09.675112465 +0000 UTC m=+169.073843321" Jun 02 21:44:10.665213 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:10.665153 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" event={"ID":"fee33acf-ec72-4270-b56a-93d9d177744d","Type":"ContainerStarted","Data":"1b2186c3cd52ef41424f4dceac341ec4fac7a8e800fc18c84a0ca0d9b8e70370"} Jun 02 21:44:10.665213 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:10.665213 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" event={"ID":"fee33acf-ec72-4270-b56a-93d9d177744d","Type":"ContainerStarted","Data":"5b5784ed8dc330d10376136ccee25ee661f7cc18511deb4988b4b263bd7f2a0f"} Jun 02 21:44:10.686723 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:10.686655 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-657f7c8cbf-55xp5" podStartSLOduration=1.836262397 podStartE2EDuration="4.686637882s" podCreationTimestamp="2026-06-02 21:44:06 +0000 UTC" firstStartedPulling="2026-06-02 21:44:06.874494909 +0000 UTC m=+166.273225743" lastFinishedPulling="2026-06-02 21:44:09.724870392 +0000 UTC m=+169.123601228" observedRunningTime="2026-06-02 21:44:10.685549838 +0000 UTC m=+170.084280695" watchObservedRunningTime="2026-06-02 21:44:10.686637882 +0000 UTC m=+170.085368737" Jun 02 21:44:12.103772 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:12.103732 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:44:12.673206 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:12.673131 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nt5bn" event={"ID":"7db682da-cedd-4e2b-9880-cc2ed25ab154","Type":"ContainerStarted","Data":"14cdd8536cc2f7aa7a212a4de07f5df03154b223aff088bcf9977789a5de24dc"} Jun 02 21:44:12.688313 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:12.688259 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nt5bn" podStartSLOduration=135.329724465 podStartE2EDuration="2m17.688243195s" podCreationTimestamp="2026-06-02 21:41:55 +0000 UTC" firstStartedPulling="2026-06-02 21:44:09.265658219 +0000 UTC m=+168.664389051" lastFinishedPulling="2026-06-02 21:44:11.624176944 +0000 UTC m=+171.022907781" observedRunningTime="2026-06-02 21:44:12.687285802 +0000 UTC m=+172.086016657" watchObservedRunningTime="2026-06-02 21:44:12.688243195 +0000 UTC m=+172.086974101" Jun 02 21:44:15.645679 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:15.645647 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jl288" Jun 02 21:44:17.108322 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:17.104083 2565 scope.go:117] "RemoveContainer" containerID="858a472c2a2d31b92cbf4aa5a505a02988de98dfebab22b5b4c321ecfc4bc6b5" Jun 02 21:44:17.690916 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:17.690879 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:44:17.691107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:17.691008 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" event={"ID":"3f7c38e8-5dfc-4627-bb00-4b318c4a936c","Type":"ContainerStarted","Data":"ea06d13f57c81e7a08ecb297cf64fd2ff145599fe83053d246d65543f18f129e"} Jun 02 21:44:17.691399 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:17.691372 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:44:17.700361 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:17.699444 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" Jun 02 21:44:17.731291 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:17.731234 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-f5jfk" podStartSLOduration=54.899441714 podStartE2EDuration="56.731220127s" podCreationTimestamp="2026-06-02 21:43:21 +0000 UTC" firstStartedPulling="2026-06-02 21:43:21.673964649 +0000 UTC m=+121.072695482" lastFinishedPulling="2026-06-02 21:43:23.505743055 +0000 UTC m=+122.904473895" observedRunningTime="2026-06-02 21:44:17.729637284 +0000 UTC m=+177.128368138" watchObservedRunningTime="2026-06-02 21:44:17.731220127 +0000 UTC m=+177.129950994" Jun 02 21:44:23.418985 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:23.418948 2565 patch_prober.go:28] interesting pod/image-registry-769ff5485f-lwr8j container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 21:44:23.419432 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:23.419000 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" podUID="9b49276d-9a26-444b-a804-290eb1404afe" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 21:44:24.639795 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:24.639767 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:24.749750 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:24.749714 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-769ff5485f-lwr8j"] Jun 02 21:44:36.743276 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:36.743242 2565 generic.go:358] "Generic (PLEG): container finished" podID="1836e217-5ee9-4b11-8192-01bf98207a5e" containerID="39cb793d83fa9c92279d6783def6819b8d710cb21b02b81b3ff4d0d9a546ce4d" exitCode=0 Jun 02 21:44:36.743639 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:36.743316 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" event={"ID":"1836e217-5ee9-4b11-8192-01bf98207a5e","Type":"ContainerDied","Data":"39cb793d83fa9c92279d6783def6819b8d710cb21b02b81b3ff4d0d9a546ce4d"} Jun 02 21:44:36.743703 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:36.743661 2565 scope.go:117] "RemoveContainer" containerID="39cb793d83fa9c92279d6783def6819b8d710cb21b02b81b3ff4d0d9a546ce4d" Jun 02 21:44:37.747599 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:37.747562 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-hk5tw" event={"ID":"1836e217-5ee9-4b11-8192-01bf98207a5e","Type":"ContainerStarted","Data":"fd128f7307252dd572e59a56b8731a0611846918c84c8b8b439ff98640086f18"} Jun 02 21:44:38.427669 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.427631 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd9685844-ksflq"] Jun 02 21:44:38.429667 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.429644 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.432844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.432824 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4jddz\"" Jun 02 21:44:38.432844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.432837 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 21:44:38.433011 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.432945 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 21:44:38.433011 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.432995 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 21:44:38.433112 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.433073 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 21:44:38.433188 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.433113 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 21:44:38.433237 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.433185 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 21:44:38.433237 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.433192 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 21:44:38.437204 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.437158 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 21:44:38.440649 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.440629 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd9685844-ksflq"] Jun 02 21:44:38.510128 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-oauth-config\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.510288 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-serving-cert\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.510288 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/ba753787-b9e7-46c8-877e-7f53503bb87c-kube-api-access-zs8gw\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.510361 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510291 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-console-config\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.510361 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-service-ca\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.510361 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-trusted-ca-bundle\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.510455 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.510389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-oauth-serving-cert\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611497 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611461 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-oauth-config\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611497 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611504 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-serving-cert\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611718 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611544 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/ba753787-b9e7-46c8-877e-7f53503bb87c-kube-api-access-zs8gw\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611718 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611570 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-console-config\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611718 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611588 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-service-ca\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611718 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611606 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-trusted-ca-bundle\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.611718 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.611626 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-oauth-serving-cert\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.612459 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.612437 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-service-ca\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.612459 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.612452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-console-config\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.612582 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.612482 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-oauth-serving-cert\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.612582 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.612551 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-trusted-ca-bundle\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.614126 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.614097 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-oauth-config\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.614240 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.614126 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-serving-cert\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.618659 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.618642 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/ba753787-b9e7-46c8-877e-7f53503bb87c-kube-api-access-zs8gw\") pod \"console-7bd9685844-ksflq\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.739551 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.739521 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:38.861943 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:38.861880 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd9685844-ksflq"] Jun 02 21:44:38.864816 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:44:38.864790 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba753787_b9e7_46c8_877e_7f53503bb87c.slice/crio-62efafdd2b7097d975ab331b4eb5e494d15e4aa597b53eb692105f0892dc80bc WatchSource:0}: Error finding container 62efafdd2b7097d975ab331b4eb5e494d15e4aa597b53eb692105f0892dc80bc: Status 404 returned error can't find the container with id 62efafdd2b7097d975ab331b4eb5e494d15e4aa597b53eb692105f0892dc80bc Jun 02 21:44:39.755080 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:39.755026 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9685844-ksflq" event={"ID":"ba753787-b9e7-46c8-877e-7f53503bb87c","Type":"ContainerStarted","Data":"62efafdd2b7097d975ab331b4eb5e494d15e4aa597b53eb692105f0892dc80bc"} Jun 02 21:44:41.764772 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:41.764737 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9685844-ksflq" event={"ID":"ba753787-b9e7-46c8-877e-7f53503bb87c","Type":"ContainerStarted","Data":"f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe"} Jun 02 21:44:41.780180 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:41.780117 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7bd9685844-ksflq" podStartSLOduration=1.187168651 podStartE2EDuration="3.780101543s" podCreationTimestamp="2026-06-02 21:44:38 +0000 UTC" firstStartedPulling="2026-06-02 21:44:38.866766827 +0000 UTC m=+198.265497660" lastFinishedPulling="2026-06-02 21:44:41.459699719 +0000 UTC m=+200.858430552" observedRunningTime="2026-06-02 21:44:41.779322004 +0000 UTC m=+201.178052859" watchObservedRunningTime="2026-06-02 21:44:41.780101543 +0000 UTC m=+201.178832399" Jun 02 21:44:48.740223 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:48.740181 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:48.740634 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:48.740239 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:48.745208 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:48.745186 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:48.789538 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:48.789511 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:44:49.769140 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:49.769074 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" podUID="9b49276d-9a26-444b-a804-290eb1404afe" containerName="registry" containerID="cri-o://4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780" gracePeriod=30 Jun 02 21:44:50.008953 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.008933 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:50.113505 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113412 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-image-registry-private-configuration\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113505 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113460 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b49276d-9a26-444b-a804-290eb1404afe-ca-trust-extracted\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113748 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113520 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-installation-pull-secrets\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113748 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113543 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-bound-sa-token\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113748 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113568 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-registry-certificates\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113748 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113647 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-trusted-ca\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113748 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113698 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsn8v\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-kube-api-access-tsn8v\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.113974 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.113762 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") pod \"9b49276d-9a26-444b-a804-290eb1404afe\" (UID: \"9b49276d-9a26-444b-a804-290eb1404afe\") " Jun 02 21:44:50.114340 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.114027 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:44:50.114340 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.114081 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:44:50.116549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.116518 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:44:50.116549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.116545 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:50.116699 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.116680 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-kube-api-access-tsn8v" (OuterVolumeSpecName: "kube-api-access-tsn8v") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "kube-api-access-tsn8v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:50.116750 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.116685 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:44:50.116750 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.116713 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:44:50.122736 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.122713 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b49276d-9a26-444b-a804-290eb1404afe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9b49276d-9a26-444b-a804-290eb1404afe" (UID: "9b49276d-9a26-444b-a804-290eb1404afe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:44:50.215014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.214976 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-installation-pull-secrets\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215009 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-bound-sa-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215023 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-registry-certificates\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215294 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215035 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b49276d-9a26-444b-a804-290eb1404afe-trusted-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215294 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215048 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsn8v\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-kube-api-access-tsn8v\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215294 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215060 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b49276d-9a26-444b-a804-290eb1404afe-registry-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215294 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215072 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b49276d-9a26-444b-a804-290eb1404afe-image-registry-private-configuration\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.215294 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.215101 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b49276d-9a26-444b-a804-290eb1404afe-ca-trust-extracted\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:44:50.793177 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.793131 2565 generic.go:358] "Generic (PLEG): container finished" podID="9b49276d-9a26-444b-a804-290eb1404afe" containerID="4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780" exitCode=0 Jun 02 21:44:50.793572 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.793226 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" Jun 02 21:44:50.793572 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.793224 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" event={"ID":"9b49276d-9a26-444b-a804-290eb1404afe","Type":"ContainerDied","Data":"4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780"} Jun 02 21:44:50.793572 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.793264 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-769ff5485f-lwr8j" event={"ID":"9b49276d-9a26-444b-a804-290eb1404afe","Type":"ContainerDied","Data":"7fb42c4adb6ce7d3da1718178e03e79ba9225ebb82e049aa9908403a42ff540a"} Jun 02 21:44:50.793572 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.793281 2565 scope.go:117] "RemoveContainer" containerID="4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780" Jun 02 21:44:50.801318 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.801297 2565 scope.go:117] "RemoveContainer" containerID="4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780" Jun 02 21:44:50.801550 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:44:50.801532 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780\": container with ID starting with 4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780 not found: ID does not exist" containerID="4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780" Jun 02 21:44:50.801602 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.801556 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780"} err="failed to get container status \"4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780\": rpc error: code = NotFound desc = could not find container \"4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780\": container with ID starting with 4e135eab27cd63e90210b7f9952d3fc0845729397ffc9452b650339cc8a85780 not found: ID does not exist" Jun 02 21:44:50.812555 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.812534 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-769ff5485f-lwr8j"] Jun 02 21:44:50.816383 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:50.816364 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-769ff5485f-lwr8j"] Jun 02 21:44:51.107808 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:44:51.107719 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b49276d-9a26-444b-a804-290eb1404afe" path="/var/lib/kubelet/pods/9b49276d-9a26-444b-a804-290eb1404afe/volumes" Jun 02 21:45:00.823542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:00.823507 2565 generic.go:358] "Generic (PLEG): container finished" podID="c3f788e4-9d3f-4305-bf7f-82e27d69e891" containerID="56b4c20f31b3da3cf14cb474162a496654a7ff081ffd2767933ae9bbc590e193" exitCode=0 Jun 02 21:45:00.824024 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:00.823583 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" event={"ID":"c3f788e4-9d3f-4305-bf7f-82e27d69e891","Type":"ContainerDied","Data":"56b4c20f31b3da3cf14cb474162a496654a7ff081ffd2767933ae9bbc590e193"} Jun 02 21:45:00.824024 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:00.823989 2565 scope.go:117] "RemoveContainer" containerID="56b4c20f31b3da3cf14cb474162a496654a7ff081ffd2767933ae9bbc590e193" Jun 02 21:45:01.828116 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:01.828075 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-6qlzl" event={"ID":"c3f788e4-9d3f-4305-bf7f-82e27d69e891","Type":"ContainerStarted","Data":"8fd915024d4c1f7ca00551f4ba5edf57991e4fb59ef97710663d18302b02353d"} Jun 02 21:45:28.680987 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:28.680954 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd9685844-ksflq"] Jun 02 21:45:31.950346 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:31.950240 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:45:31.952564 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:31.952531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32df7e35-cd92-413d-8b1d-7e671a424340-metrics-certs\") pod \"network-metrics-daemon-ss85j\" (UID: \"32df7e35-cd92-413d-8b1d-7e671a424340\") " pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:45:32.206764 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:32.206658 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96ccb\"" Jun 02 21:45:32.214560 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:32.214529 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ss85j" Jun 02 21:45:32.345828 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:32.345802 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ss85j"] Jun 02 21:45:32.348557 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:45:32.348525 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32df7e35_cd92_413d_8b1d_7e671a424340.slice/crio-c09955aba7ae34b1ace7deda4f482d00899004cd319b91fa2365cdc62318536e WatchSource:0}: Error finding container c09955aba7ae34b1ace7deda4f482d00899004cd319b91fa2365cdc62318536e: Status 404 returned error can't find the container with id c09955aba7ae34b1ace7deda4f482d00899004cd319b91fa2365cdc62318536e Jun 02 21:45:32.917008 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:32.916966 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ss85j" event={"ID":"32df7e35-cd92-413d-8b1d-7e671a424340","Type":"ContainerStarted","Data":"c09955aba7ae34b1ace7deda4f482d00899004cd319b91fa2365cdc62318536e"} Jun 02 21:45:33.923287 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:33.922338 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ss85j" event={"ID":"32df7e35-cd92-413d-8b1d-7e671a424340","Type":"ContainerStarted","Data":"294979483ba526d826d827217efeb9a76a0b9d28478e57ff6e8c0108481b1233"} Jun 02 21:45:33.923287 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:33.922383 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ss85j" event={"ID":"32df7e35-cd92-413d-8b1d-7e671a424340","Type":"ContainerStarted","Data":"fd9e3e2b0869742a5efd8d8ebd6e74734a44fb1dd6bb4a250cf552229e5434f2"} Jun 02 21:45:33.940392 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:33.940341 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ss85j" podStartSLOduration=251.954195071 podStartE2EDuration="4m12.940328766s" podCreationTimestamp="2026-06-02 21:41:21 +0000 UTC" firstStartedPulling="2026-06-02 21:45:32.350276701 +0000 UTC m=+251.749007533" lastFinishedPulling="2026-06-02 21:45:33.336410384 +0000 UTC m=+252.735141228" observedRunningTime="2026-06-02 21:45:33.93912634 +0000 UTC m=+253.337857195" watchObservedRunningTime="2026-06-02 21:45:33.940328766 +0000 UTC m=+253.339059621" Jun 02 21:45:53.706123 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.706057 2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7bd9685844-ksflq" podUID="ba753787-b9e7-46c8-877e-7f53503bb87c" containerName="console" containerID="cri-o://f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe" gracePeriod=15 Jun 02 21:45:53.966489 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.966435 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd9685844-ksflq_ba753787-b9e7-46c8-877e-7f53503bb87c/console/0.log" Jun 02 21:45:53.966590 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.966493 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:45:53.981934 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.981910 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bd9685844-ksflq_ba753787-b9e7-46c8-877e-7f53503bb87c/console/0.log" Jun 02 21:45:53.982053 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.981951 2565 generic.go:358] "Generic (PLEG): container finished" podID="ba753787-b9e7-46c8-877e-7f53503bb87c" containerID="f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe" exitCode=2 Jun 02 21:45:53.982053 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.982000 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9685844-ksflq" Jun 02 21:45:53.982131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.982044 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9685844-ksflq" event={"ID":"ba753787-b9e7-46c8-877e-7f53503bb87c","Type":"ContainerDied","Data":"f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe"} Jun 02 21:45:53.982131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.982081 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9685844-ksflq" event={"ID":"ba753787-b9e7-46c8-877e-7f53503bb87c","Type":"ContainerDied","Data":"62efafdd2b7097d975ab331b4eb5e494d15e4aa597b53eb692105f0892dc80bc"} Jun 02 21:45:53.982131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.982096 2565 scope.go:117] "RemoveContainer" containerID="f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe" Jun 02 21:45:53.991100 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.991091 2565 scope.go:117] "RemoveContainer" containerID="f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe" Jun 02 21:45:53.991392 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:45:53.991373 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe\": container with ID starting with f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe not found: ID does not exist" containerID="f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe" Jun 02 21:45:53.991494 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:53.991401 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe"} err="failed to get container status \"f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe\": rpc error: code = NotFound desc = could not find container \"f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe\": container with ID starting with f0c5229e8a759a9ab25e9200882d01e676b8aef820c3a32f4b03f83e82b962fe not found: ID does not exist" Jun 02 21:45:54.034322 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034299 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-oauth-serving-cert\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034451 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034333 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-trusted-ca-bundle\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034451 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034354 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-oauth-config\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034451 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034388 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-serving-cert\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034614 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034517 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-console-config\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034614 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034572 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-service-ca\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034717 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034610 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/ba753787-b9e7-46c8-877e-7f53503bb87c-kube-api-access-zs8gw\") pod \"ba753787-b9e7-46c8-877e-7f53503bb87c\" (UID: \"ba753787-b9e7-46c8-877e-7f53503bb87c\") " Jun 02 21:45:54.034839 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034715 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:54.034914 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034876 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:54.034955 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034904 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-console-config" (OuterVolumeSpecName: "console-config") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:54.034994 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.034973 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 21:45:54.036578 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.036547 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:54.036578 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.036562 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 21:45:54.036695 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.036604 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba753787-b9e7-46c8-877e-7f53503bb87c-kube-api-access-zs8gw" (OuterVolumeSpecName: "kube-api-access-zs8gw") pod "ba753787-b9e7-46c8-877e-7f53503bb87c" (UID: "ba753787-b9e7-46c8-877e-7f53503bb87c"). InnerVolumeSpecName "kube-api-access-zs8gw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:45:54.135874 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135844 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-trusted-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.135874 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135873 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-oauth-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.136039 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135887 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba753787-b9e7-46c8-877e-7f53503bb87c-console-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.136039 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135900 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-console-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.136039 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135912 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.136039 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135923 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs8gw\" (UniqueName: \"kubernetes.io/projected/ba753787-b9e7-46c8-877e-7f53503bb87c-kube-api-access-zs8gw\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.136039 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.135935 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba753787-b9e7-46c8-877e-7f53503bb87c-oauth-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:45:54.302945 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.302915 2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd9685844-ksflq"] Jun 02 21:45:54.306363 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:54.306336 2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd9685844-ksflq"] Jun 02 21:45:55.107083 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:55.107049 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba753787-b9e7-46c8-877e-7f53503bb87c" path="/var/lib/kubelet/pods/ba753787-b9e7-46c8-877e-7f53503bb87c/volumes" Jun 02 21:45:56.792988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.792958 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw"] Jun 02 21:45:56.793374 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.793273 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba753787-b9e7-46c8-877e-7f53503bb87c" containerName="console" Jun 02 21:45:56.793374 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.793285 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba753787-b9e7-46c8-877e-7f53503bb87c" containerName="console" Jun 02 21:45:56.793374 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.793294 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b49276d-9a26-444b-a804-290eb1404afe" containerName="registry" Jun 02 21:45:56.793374 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.793300 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b49276d-9a26-444b-a804-290eb1404afe" containerName="registry" Jun 02 21:45:56.793374 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.793344 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="9b49276d-9a26-444b-a804-290eb1404afe" containerName="registry" Jun 02 21:45:56.793374 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.793351 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba753787-b9e7-46c8-877e-7f53503bb87c" containerName="console" Jun 02 21:45:56.799236 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.799208 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.801638 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.801612 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:45:56.801762 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.801657 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:45:56.802594 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.802570 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6fch\"" Jun 02 21:45:56.804553 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.804533 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw"] Jun 02 21:45:56.856429 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.856401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j947p\" (UniqueName: \"kubernetes.io/projected/cd09982e-4e48-408f-80ca-4449207dda5b-kube-api-access-j947p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.856557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.856443 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.856557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.856469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.957903 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.957873 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j947p\" (UniqueName: \"kubernetes.io/projected/cd09982e-4e48-408f-80ca-4449207dda5b-kube-api-access-j947p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.958040 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.957914 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.958040 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.957943 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.958292 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.958275 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.958372 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.958351 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:56.965699 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:56.965679 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j947p\" (UniqueName: \"kubernetes.io/projected/cd09982e-4e48-408f-80ca-4449207dda5b-kube-api-access-j947p\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:57.109511 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:57.109426 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:45:57.251955 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:57.251917 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw"] Jun 02 21:45:57.254951 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:45:57.254926 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd09982e_4e48_408f_80ca_4449207dda5b.slice/crio-f4c4b702ae9bcb8f31926f62b73601cc2f9a1df2944264e0d04465da1218d51f WatchSource:0}: Error finding container f4c4b702ae9bcb8f31926f62b73601cc2f9a1df2944264e0d04465da1218d51f: Status 404 returned error can't find the container with id f4c4b702ae9bcb8f31926f62b73601cc2f9a1df2944264e0d04465da1218d51f Jun 02 21:45:57.996347 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:45:57.996298 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" event={"ID":"cd09982e-4e48-408f-80ca-4449207dda5b","Type":"ContainerStarted","Data":"f4c4b702ae9bcb8f31926f62b73601cc2f9a1df2944264e0d04465da1218d51f"} Jun 02 21:46:03.011490 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:03.011453 2565 generic.go:358] "Generic (PLEG): container finished" podID="cd09982e-4e48-408f-80ca-4449207dda5b" containerID="4a3ba3436a34035ade8d7a8ce2e15d74ce3e8b56419cae2b92014bb22708235a" exitCode=0 Jun 02 21:46:03.011897 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:03.011539 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" event={"ID":"cd09982e-4e48-408f-80ca-4449207dda5b","Type":"ContainerDied","Data":"4a3ba3436a34035ade8d7a8ce2e15d74ce3e8b56419cae2b92014bb22708235a"} Jun 02 21:46:05.018928 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:05.018892 2565 generic.go:358] "Generic (PLEG): container finished" podID="cd09982e-4e48-408f-80ca-4449207dda5b" containerID="77a229dfa168a69d3c7f931b5456c72c8a161bff62f72c38ce720aaf9dfde52e" exitCode=0 Jun 02 21:46:05.019445 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:05.018974 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" event={"ID":"cd09982e-4e48-408f-80ca-4449207dda5b","Type":"ContainerDied","Data":"77a229dfa168a69d3c7f931b5456c72c8a161bff62f72c38ce720aaf9dfde52e"} Jun 02 21:46:12.040177 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:12.040137 2565 generic.go:358] "Generic (PLEG): container finished" podID="cd09982e-4e48-408f-80ca-4449207dda5b" containerID="96f433979d1a03b86af99e4f9aaff4a0dcad32c53bb422891af25480e2c985c4" exitCode=0 Jun 02 21:46:12.040586 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:12.040234 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" event={"ID":"cd09982e-4e48-408f-80ca-4449207dda5b","Type":"ContainerDied","Data":"96f433979d1a03b86af99e4f9aaff4a0dcad32c53bb422891af25480e2c985c4"} Jun 02 21:46:13.168582 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.168555 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:46:13.294937 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.294857 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-bundle\") pod \"cd09982e-4e48-408f-80ca-4449207dda5b\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " Jun 02 21:46:13.294937 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.294917 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j947p\" (UniqueName: \"kubernetes.io/projected/cd09982e-4e48-408f-80ca-4449207dda5b-kube-api-access-j947p\") pod \"cd09982e-4e48-408f-80ca-4449207dda5b\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " Jun 02 21:46:13.294937 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.294940 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-util\") pod \"cd09982e-4e48-408f-80ca-4449207dda5b\" (UID: \"cd09982e-4e48-408f-80ca-4449207dda5b\") " Jun 02 21:46:13.295557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.295526 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-bundle" (OuterVolumeSpecName: "bundle") pod "cd09982e-4e48-408f-80ca-4449207dda5b" (UID: "cd09982e-4e48-408f-80ca-4449207dda5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:13.297103 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.297073 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd09982e-4e48-408f-80ca-4449207dda5b-kube-api-access-j947p" (OuterVolumeSpecName: "kube-api-access-j947p") pod "cd09982e-4e48-408f-80ca-4449207dda5b" (UID: "cd09982e-4e48-408f-80ca-4449207dda5b"). InnerVolumeSpecName "kube-api-access-j947p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:13.298927 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.298900 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-util" (OuterVolumeSpecName: "util") pod "cd09982e-4e48-408f-80ca-4449207dda5b" (UID: "cd09982e-4e48-408f-80ca-4449207dda5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:13.396085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.396054 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j947p\" (UniqueName: \"kubernetes.io/projected/cd09982e-4e48-408f-80ca-4449207dda5b-kube-api-access-j947p\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:13.396085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.396080 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:13.396085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:13.396089 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd09982e-4e48-408f-80ca-4449207dda5b-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:14.047210 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:14.047182 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" Jun 02 21:46:14.047210 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:14.047192 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dgm2nw" event={"ID":"cd09982e-4e48-408f-80ca-4449207dda5b","Type":"ContainerDied","Data":"f4c4b702ae9bcb8f31926f62b73601cc2f9a1df2944264e0d04465da1218d51f"} Jun 02 21:46:14.047415 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:14.047224 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f4c4b702ae9bcb8f31926f62b73601cc2f9a1df2944264e0d04465da1218d51f" Jun 02 21:46:19.778479 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778436 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d"] Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778854 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="pull" Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778871 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="pull" Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778897 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="extract" Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778906 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="extract" Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778921 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="util" Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.778930 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="util" Jun 02 21:46:19.779048 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.779006 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="cd09982e-4e48-408f-80ca-4449207dda5b" containerName="extract" Jun 02 21:46:19.783844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.783822 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:19.786152 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.786130 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5jjvh\"" Jun 02 21:46:19.786278 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.786154 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 21:46:19.786278 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.786228 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 21:46:19.795416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.795392 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d"] Jun 02 21:46:19.848023 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.847979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2f24d54-7df9-4ede-b858-afc6cc209289-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-p829d\" (UID: \"e2f24d54-7df9-4ede-b858-afc6cc209289\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:19.848225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.848028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvpnf\" (UniqueName: \"kubernetes.io/projected/e2f24d54-7df9-4ede-b858-afc6cc209289-kube-api-access-fvpnf\") pod \"cert-manager-operator-controller-manager-54b9655956-p829d\" (UID: \"e2f24d54-7df9-4ede-b858-afc6cc209289\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:19.949469 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.949429 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2f24d54-7df9-4ede-b858-afc6cc209289-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-p829d\" (UID: \"e2f24d54-7df9-4ede-b858-afc6cc209289\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:19.949469 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.949472 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvpnf\" (UniqueName: \"kubernetes.io/projected/e2f24d54-7df9-4ede-b858-afc6cc209289-kube-api-access-fvpnf\") pod \"cert-manager-operator-controller-manager-54b9655956-p829d\" (UID: \"e2f24d54-7df9-4ede-b858-afc6cc209289\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:19.949841 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.949820 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2f24d54-7df9-4ede-b858-afc6cc209289-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-p829d\" (UID: \"e2f24d54-7df9-4ede-b858-afc6cc209289\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:19.956991 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:19.956967 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvpnf\" (UniqueName: \"kubernetes.io/projected/e2f24d54-7df9-4ede-b858-afc6cc209289-kube-api-access-fvpnf\") pod \"cert-manager-operator-controller-manager-54b9655956-p829d\" (UID: \"e2f24d54-7df9-4ede-b858-afc6cc209289\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:20.093120 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:20.093032 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" Jun 02 21:46:20.222081 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:20.222045 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d"] Jun 02 21:46:20.225426 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:20.225391 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f24d54_7df9_4ede_b858_afc6cc209289.slice/crio-cdd2708540d5d2ffb5fa5b364004ce210756f3a692ccc75a41c4fd7033fd6229 WatchSource:0}: Error finding container cdd2708540d5d2ffb5fa5b364004ce210756f3a692ccc75a41c4fd7033fd6229: Status 404 returned error can't find the container with id cdd2708540d5d2ffb5fa5b364004ce210756f3a692ccc75a41c4fd7033fd6229 Jun 02 21:46:21.031129 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:21.031098 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:46:21.032223 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:21.032200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:46:21.043121 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:21.043100 2565 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 21:46:21.068485 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:21.068453 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" event={"ID":"e2f24d54-7df9-4ede-b858-afc6cc209289","Type":"ContainerStarted","Data":"cdd2708540d5d2ffb5fa5b364004ce210756f3a692ccc75a41c4fd7033fd6229"} Jun 02 21:46:23.076388 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:23.076351 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" event={"ID":"e2f24d54-7df9-4ede-b858-afc6cc209289","Type":"ContainerStarted","Data":"a40352b665868cb29a8bc823f13962cc55face368c6ef387914dd09caa05f96b"} Jun 02 21:46:23.097546 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:23.097497 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-p829d" podStartSLOduration=2.096948717 podStartE2EDuration="4.097483431s" podCreationTimestamp="2026-06-02 21:46:19 +0000 UTC" firstStartedPulling="2026-06-02 21:46:20.22788749 +0000 UTC m=+299.626618324" lastFinishedPulling="2026-06-02 21:46:22.228422196 +0000 UTC m=+301.627153038" observedRunningTime="2026-06-02 21:46:23.094878717 +0000 UTC m=+302.493609569" watchObservedRunningTime="2026-06-02 21:46:23.097483431 +0000 UTC m=+302.496214286" Jun 02 21:46:24.023513 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.023476 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6"] Jun 02 21:46:24.025746 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.025731 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.027999 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.027970 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:46:24.028125 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.028001 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:46:24.028936 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.028902 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6fch\"" Jun 02 21:46:24.035129 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.035106 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6"] Jun 02 21:46:24.082222 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.082186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.082583 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.082240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khlck\" (UniqueName: \"kubernetes.io/projected/87bad8e3-eac4-4a16-b79d-82f2092a2520-kube-api-access-khlck\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.082583 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.082290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.182654 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.182612 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.182654 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.182661 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khlck\" (UniqueName: \"kubernetes.io/projected/87bad8e3-eac4-4a16-b79d-82f2092a2520-kube-api-access-khlck\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.182913 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.182714 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.183119 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.183099 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.183224 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.183185 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.193944 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.193922 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khlck\" (UniqueName: \"kubernetes.io/projected/87bad8e3-eac4-4a16-b79d-82f2092a2520-kube-api-access-khlck\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.335729 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.335626 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:24.466115 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.466086 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6"] Jun 02 21:46:24.468033 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:24.468005 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bad8e3_eac4_4a16_b79d_82f2092a2520.slice/crio-2db9d4e18190cfaed5dc50cbff0c2a78f504ebfec06978c3b4431fa3980446af WatchSource:0}: Error finding container 2db9d4e18190cfaed5dc50cbff0c2a78f504ebfec06978c3b4431fa3980446af: Status 404 returned error can't find the container with id 2db9d4e18190cfaed5dc50cbff0c2a78f504ebfec06978c3b4431fa3980446af Jun 02 21:46:24.469917 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:24.469898 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:46:25.050549 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.050513 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-fg4m2"] Jun 02 21:46:25.052917 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.052900 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.054970 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.054949 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 21:46:25.055099 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.055080 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-swsjz\"" Jun 02 21:46:25.055822 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.055806 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 21:46:25.059061 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.059040 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-fg4m2"] Jun 02 21:46:25.083624 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.083590 2565 generic.go:358] "Generic (PLEG): container finished" podID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerID="a915663815b0980bf9c7d180b71f236f91608572a23e9da3997c0be90fe762d2" exitCode=0 Jun 02 21:46:25.083954 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.083675 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" event={"ID":"87bad8e3-eac4-4a16-b79d-82f2092a2520","Type":"ContainerDied","Data":"a915663815b0980bf9c7d180b71f236f91608572a23e9da3997c0be90fe762d2"} Jun 02 21:46:25.083954 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.083717 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" event={"ID":"87bad8e3-eac4-4a16-b79d-82f2092a2520","Type":"ContainerStarted","Data":"2db9d4e18190cfaed5dc50cbff0c2a78f504ebfec06978c3b4431fa3980446af"} Jun 02 21:46:25.190842 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.190803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd9bk\" (UniqueName: \"kubernetes.io/projected/fc226afb-5ea9-438d-a1dd-fe1ff961584f-kube-api-access-hd9bk\") pod \"cert-manager-webhook-587ccfb98-fg4m2\" (UID: \"fc226afb-5ea9-438d-a1dd-fe1ff961584f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.191014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.190995 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc226afb-5ea9-438d-a1dd-fe1ff961584f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-fg4m2\" (UID: \"fc226afb-5ea9-438d-a1dd-fe1ff961584f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.291936 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.291902 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hd9bk\" (UniqueName: \"kubernetes.io/projected/fc226afb-5ea9-438d-a1dd-fe1ff961584f-kube-api-access-hd9bk\") pod \"cert-manager-webhook-587ccfb98-fg4m2\" (UID: \"fc226afb-5ea9-438d-a1dd-fe1ff961584f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.292088 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.291954 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc226afb-5ea9-438d-a1dd-fe1ff961584f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-fg4m2\" (UID: \"fc226afb-5ea9-438d-a1dd-fe1ff961584f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.302511 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.302445 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc226afb-5ea9-438d-a1dd-fe1ff961584f-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-fg4m2\" (UID: \"fc226afb-5ea9-438d-a1dd-fe1ff961584f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.302621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.302592 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd9bk\" (UniqueName: \"kubernetes.io/projected/fc226afb-5ea9-438d-a1dd-fe1ff961584f-kube-api-access-hd9bk\") pod \"cert-manager-webhook-587ccfb98-fg4m2\" (UID: \"fc226afb-5ea9-438d-a1dd-fe1ff961584f\") " pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.372597 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.372558 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:25.523091 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:25.522906 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-fg4m2"] Jun 02 21:46:25.525948 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:25.525919 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc226afb_5ea9_438d_a1dd_fe1ff961584f.slice/crio-29729b55fb5dec2792fb30c9e068ecb235300b3e0310653a1ef54a9d904c06b6 WatchSource:0}: Error finding container 29729b55fb5dec2792fb30c9e068ecb235300b3e0310653a1ef54a9d904c06b6: Status 404 returned error can't find the container with id 29729b55fb5dec2792fb30c9e068ecb235300b3e0310653a1ef54a9d904c06b6 Jun 02 21:46:26.088747 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:26.088710 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" event={"ID":"fc226afb-5ea9-438d-a1dd-fe1ff961584f","Type":"ContainerStarted","Data":"29729b55fb5dec2792fb30c9e068ecb235300b3e0310653a1ef54a9d904c06b6"} Jun 02 21:46:27.094403 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:27.094309 2565 generic.go:358] "Generic (PLEG): container finished" podID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerID="26121a6915a63f119a09f2be9ac94916be0d5aae70c6700936f882c80a383b39" exitCode=0 Jun 02 21:46:27.094779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:27.094413 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" event={"ID":"87bad8e3-eac4-4a16-b79d-82f2092a2520","Type":"ContainerDied","Data":"26121a6915a63f119a09f2be9ac94916be0d5aae70c6700936f882c80a383b39"} Jun 02 21:46:28.100111 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:28.100072 2565 generic.go:358] "Generic (PLEG): container finished" podID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerID="66dbb5e37338befea92cf2efc8f42d9d250d3d58296d7076454434fd13b034bc" exitCode=0 Jun 02 21:46:28.100558 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:28.100184 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" event={"ID":"87bad8e3-eac4-4a16-b79d-82f2092a2520","Type":"ContainerDied","Data":"66dbb5e37338befea92cf2efc8f42d9d250d3d58296d7076454434fd13b034bc"} Jun 02 21:46:29.235391 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.235363 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:29.329808 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.329776 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-bundle\") pod \"87bad8e3-eac4-4a16-b79d-82f2092a2520\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " Jun 02 21:46:29.329963 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.329839 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khlck\" (UniqueName: \"kubernetes.io/projected/87bad8e3-eac4-4a16-b79d-82f2092a2520-kube-api-access-khlck\") pod \"87bad8e3-eac4-4a16-b79d-82f2092a2520\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " Jun 02 21:46:29.329963 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.329904 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-util\") pod \"87bad8e3-eac4-4a16-b79d-82f2092a2520\" (UID: \"87bad8e3-eac4-4a16-b79d-82f2092a2520\") " Jun 02 21:46:29.330278 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.330251 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-bundle" (OuterVolumeSpecName: "bundle") pod "87bad8e3-eac4-4a16-b79d-82f2092a2520" (UID: "87bad8e3-eac4-4a16-b79d-82f2092a2520"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:29.331782 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.331751 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87bad8e3-eac4-4a16-b79d-82f2092a2520-kube-api-access-khlck" (OuterVolumeSpecName: "kube-api-access-khlck") pod "87bad8e3-eac4-4a16-b79d-82f2092a2520" (UID: "87bad8e3-eac4-4a16-b79d-82f2092a2520"). InnerVolumeSpecName "kube-api-access-khlck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:29.335029 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.335005 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-util" (OuterVolumeSpecName: "util") pod "87bad8e3-eac4-4a16-b79d-82f2092a2520" (UID: "87bad8e3-eac4-4a16-b79d-82f2092a2520"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:29.431002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.430967 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khlck\" (UniqueName: \"kubernetes.io/projected/87bad8e3-eac4-4a16-b79d-82f2092a2520-kube-api-access-khlck\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:29.431002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.430998 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:29.431002 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:29.431007 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87bad8e3-eac4-4a16-b79d-82f2092a2520-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:30.113414 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.113377 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" event={"ID":"87bad8e3-eac4-4a16-b79d-82f2092a2520","Type":"ContainerDied","Data":"2db9d4e18190cfaed5dc50cbff0c2a78f504ebfec06978c3b4431fa3980446af"} Jun 02 21:46:30.113414 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.113414 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2db9d4e18190cfaed5dc50cbff0c2a78f504ebfec06978c3b4431fa3980446af" Jun 02 21:46:30.113414 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.113395 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp4rn6" Jun 02 21:46:30.114779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.114753 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" event={"ID":"fc226afb-5ea9-438d-a1dd-fe1ff961584f","Type":"ContainerStarted","Data":"ca0c6f37e0b8594667502087a22cc69c4cebf5bdd321eec61566a143bc4cd448"} Jun 02 21:46:30.114899 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.114875 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:30.129276 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.129139 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" podStartSLOduration=1.570837931 podStartE2EDuration="5.129120436s" podCreationTimestamp="2026-06-02 21:46:25 +0000 UTC" firstStartedPulling="2026-06-02 21:46:25.528353926 +0000 UTC m=+304.927084759" lastFinishedPulling="2026-06-02 21:46:29.086636427 +0000 UTC m=+308.485367264" observedRunningTime="2026-06-02 21:46:30.128030698 +0000 UTC m=+309.526761553" watchObservedRunningTime="2026-06-02 21:46:30.129120436 +0000 UTC m=+309.527851510" Jun 02 21:46:30.343079 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343044 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-7s4t5"] Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343374 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="extract" Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343386 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="extract" Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343403 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="util" Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343408 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="util" Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343414 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="pull" Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343419 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="pull" Jun 02 21:46:30.343477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.343469 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="87bad8e3-eac4-4a16-b79d-82f2092a2520" containerName="extract" Jun 02 21:46:30.345434 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.345418 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.347408 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.347384 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2q8rl\"" Jun 02 21:46:30.352504 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.352477 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-7s4t5"] Jun 02 21:46:30.439012 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.438925 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzmzh\" (UniqueName: \"kubernetes.io/projected/46fb0987-39ab-4793-a6c6-e60e57ab15b0-kube-api-access-nzmzh\") pod \"cert-manager-cainjector-68b757865b-7s4t5\" (UID: \"46fb0987-39ab-4793-a6c6-e60e57ab15b0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.439012 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.438979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46fb0987-39ab-4793-a6c6-e60e57ab15b0-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-7s4t5\" (UID: \"46fb0987-39ab-4793-a6c6-e60e57ab15b0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.539697 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.539658 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46fb0987-39ab-4793-a6c6-e60e57ab15b0-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-7s4t5\" (UID: \"46fb0987-39ab-4793-a6c6-e60e57ab15b0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.539864 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.539798 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzmzh\" (UniqueName: \"kubernetes.io/projected/46fb0987-39ab-4793-a6c6-e60e57ab15b0-kube-api-access-nzmzh\") pod \"cert-manager-cainjector-68b757865b-7s4t5\" (UID: \"46fb0987-39ab-4793-a6c6-e60e57ab15b0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.547182 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.547146 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46fb0987-39ab-4793-a6c6-e60e57ab15b0-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-7s4t5\" (UID: \"46fb0987-39ab-4793-a6c6-e60e57ab15b0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.547408 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.547385 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzmzh\" (UniqueName: \"kubernetes.io/projected/46fb0987-39ab-4793-a6c6-e60e57ab15b0-kube-api-access-nzmzh\") pod \"cert-manager-cainjector-68b757865b-7s4t5\" (UID: \"46fb0987-39ab-4793-a6c6-e60e57ab15b0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.655705 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.655671 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" Jun 02 21:46:30.779429 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:30.779289 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-7s4t5"] Jun 02 21:46:30.781963 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:30.781921 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46fb0987_39ab_4793_a6c6_e60e57ab15b0.slice/crio-4ab2f2eeac41b84c23da7b0ae190254d296bc357048dadce8400b9985818db71 WatchSource:0}: Error finding container 4ab2f2eeac41b84c23da7b0ae190254d296bc357048dadce8400b9985818db71: Status 404 returned error can't find the container with id 4ab2f2eeac41b84c23da7b0ae190254d296bc357048dadce8400b9985818db71 Jun 02 21:46:31.118811 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:31.118772 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" event={"ID":"46fb0987-39ab-4793-a6c6-e60e57ab15b0","Type":"ContainerStarted","Data":"1a9a4cc54580fc6184d09ced46831ed63652c2ded29371d494bc158e9dea3d77"} Jun 02 21:46:31.119040 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:31.118817 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" event={"ID":"46fb0987-39ab-4793-a6c6-e60e57ab15b0","Type":"ContainerStarted","Data":"4ab2f2eeac41b84c23da7b0ae190254d296bc357048dadce8400b9985818db71"} Jun 02 21:46:31.137604 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:31.137556 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-7s4t5" podStartSLOduration=1.137537892 podStartE2EDuration="1.137537892s" podCreationTimestamp="2026-06-02 21:46:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:46:31.135544362 +0000 UTC m=+310.534275216" watchObservedRunningTime="2026-06-02 21:46:31.137537892 +0000 UTC m=+310.536268750" Jun 02 21:46:36.121658 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:36.121625 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-fg4m2" Jun 02 21:46:42.260814 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.260777 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67"] Jun 02 21:46:42.263064 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.263046 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.265425 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.265394 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6fch\"" Jun 02 21:46:42.265593 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.265581 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:46:42.266226 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.266207 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:46:42.272338 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.272308 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67"] Jun 02 21:46:42.443327 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.443292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9gbh\" (UniqueName: \"kubernetes.io/projected/7ec1a0ab-336d-4678-a137-bc9ec683de5a-kube-api-access-q9gbh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.443499 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.443340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.443499 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.443400 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.544303 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.544197 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9gbh\" (UniqueName: \"kubernetes.io/projected/7ec1a0ab-336d-4678-a137-bc9ec683de5a-kube-api-access-q9gbh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.544303 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.544273 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.544534 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.544311 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.544676 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.544654 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.544737 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.544692 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.552076 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.552048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9gbh\" (UniqueName: \"kubernetes.io/projected/7ec1a0ab-336d-4678-a137-bc9ec683de5a-kube-api-access-q9gbh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.573042 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.573002 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:42.697857 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:42.697809 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67"] Jun 02 21:46:42.702291 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:42.702260 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec1a0ab_336d_4678_a137_bc9ec683de5a.slice/crio-89f878bed0cd7e30336217e9a38756c0310f54799632aef5828b991a034b364e WatchSource:0}: Error finding container 89f878bed0cd7e30336217e9a38756c0310f54799632aef5828b991a034b364e: Status 404 returned error can't find the container with id 89f878bed0cd7e30336217e9a38756c0310f54799632aef5828b991a034b364e Jun 02 21:46:43.159285 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.159189 2565 generic.go:358] "Generic (PLEG): container finished" podID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerID="c065a0632320f98c7209418e99e15131587ac966a82dc0ddebfae64c1ea4f23e" exitCode=0 Jun 02 21:46:43.159438 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.159289 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" event={"ID":"7ec1a0ab-336d-4678-a137-bc9ec683de5a","Type":"ContainerDied","Data":"c065a0632320f98c7209418e99e15131587ac966a82dc0ddebfae64c1ea4f23e"} Jun 02 21:46:43.159438 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.159335 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" event={"ID":"7ec1a0ab-336d-4678-a137-bc9ec683de5a","Type":"ContainerStarted","Data":"89f878bed0cd7e30336217e9a38756c0310f54799632aef5828b991a034b364e"} Jun 02 21:46:43.424684 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.424605 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-4bgtl"] Jun 02 21:46:43.427416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.427395 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.429469 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.429450 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dtktr\"" Jun 02 21:46:43.437355 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.437332 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-4bgtl"] Jun 02 21:46:43.550697 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.550648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8f7c\" (UniqueName: \"kubernetes.io/projected/34605659-ce55-475a-91eb-004b14dc5b18-kube-api-access-d8f7c\") pod \"cert-manager-79c8d999ff-4bgtl\" (UID: \"34605659-ce55-475a-91eb-004b14dc5b18\") " pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.550859 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.550757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34605659-ce55-475a-91eb-004b14dc5b18-bound-sa-token\") pod \"cert-manager-79c8d999ff-4bgtl\" (UID: \"34605659-ce55-475a-91eb-004b14dc5b18\") " pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.651854 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.651815 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34605659-ce55-475a-91eb-004b14dc5b18-bound-sa-token\") pod \"cert-manager-79c8d999ff-4bgtl\" (UID: \"34605659-ce55-475a-91eb-004b14dc5b18\") " pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.652041 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.651923 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8f7c\" (UniqueName: \"kubernetes.io/projected/34605659-ce55-475a-91eb-004b14dc5b18-kube-api-access-d8f7c\") pod \"cert-manager-79c8d999ff-4bgtl\" (UID: \"34605659-ce55-475a-91eb-004b14dc5b18\") " pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.659477 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.659449 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34605659-ce55-475a-91eb-004b14dc5b18-bound-sa-token\") pod \"cert-manager-79c8d999ff-4bgtl\" (UID: \"34605659-ce55-475a-91eb-004b14dc5b18\") " pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.659818 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.659795 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8f7c\" (UniqueName: \"kubernetes.io/projected/34605659-ce55-475a-91eb-004b14dc5b18-kube-api-access-d8f7c\") pod \"cert-manager-79c8d999ff-4bgtl\" (UID: \"34605659-ce55-475a-91eb-004b14dc5b18\") " pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.736116 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.736087 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-4bgtl" Jun 02 21:46:43.863491 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:43.863467 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-4bgtl"] Jun 02 21:46:43.865489 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:43.865466 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34605659_ce55_475a_91eb_004b14dc5b18.slice/crio-43296fb97bdffe467477b9ea32df5cff703b1eef70b0a7342b63cd09118cd4b9 WatchSource:0}: Error finding container 43296fb97bdffe467477b9ea32df5cff703b1eef70b0a7342b63cd09118cd4b9: Status 404 returned error can't find the container with id 43296fb97bdffe467477b9ea32df5cff703b1eef70b0a7342b63cd09118cd4b9 Jun 02 21:46:44.164457 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:44.164417 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-4bgtl" event={"ID":"34605659-ce55-475a-91eb-004b14dc5b18","Type":"ContainerStarted","Data":"9e3ed2ad6f012f9cbf93af37ca0f091c794fe82086457a8761e9cdb455337b37"} Jun 02 21:46:44.164457 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:44.164456 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-4bgtl" event={"ID":"34605659-ce55-475a-91eb-004b14dc5b18","Type":"ContainerStarted","Data":"43296fb97bdffe467477b9ea32df5cff703b1eef70b0a7342b63cd09118cd4b9"} Jun 02 21:46:44.166085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:44.166060 2565 generic.go:358] "Generic (PLEG): container finished" podID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerID="0f70bfc5289614a99ae2a81011455576af78a7b1e60c6132c26001f81c9ae87a" exitCode=0 Jun 02 21:46:44.166193 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:44.166128 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" event={"ID":"7ec1a0ab-336d-4678-a137-bc9ec683de5a","Type":"ContainerDied","Data":"0f70bfc5289614a99ae2a81011455576af78a7b1e60c6132c26001f81c9ae87a"} Jun 02 21:46:44.179550 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:44.179445 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-4bgtl" podStartSLOduration=1.179425759 podStartE2EDuration="1.179425759s" podCreationTimestamp="2026-06-02 21:46:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:46:44.177938081 +0000 UTC m=+323.576668934" watchObservedRunningTime="2026-06-02 21:46:44.179425759 +0000 UTC m=+323.578156617" Jun 02 21:46:45.171795 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:45.171757 2565 generic.go:358] "Generic (PLEG): container finished" podID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerID="87f8fbc217fa779fb3b6afd6850e70c6d753b210898c4907b038f8208e0e5889" exitCode=0 Jun 02 21:46:45.172275 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:45.171841 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" event={"ID":"7ec1a0ab-336d-4678-a137-bc9ec683de5a","Type":"ContainerDied","Data":"87f8fbc217fa779fb3b6afd6850e70c6d753b210898c4907b038f8208e0e5889"} Jun 02 21:46:46.309558 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.309525 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:46.476366 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.476263 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9gbh\" (UniqueName: \"kubernetes.io/projected/7ec1a0ab-336d-4678-a137-bc9ec683de5a-kube-api-access-q9gbh\") pod \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " Jun 02 21:46:46.476366 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.476327 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-bundle\") pod \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " Jun 02 21:46:46.476366 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.476364 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-util\") pod \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\" (UID: \"7ec1a0ab-336d-4678-a137-bc9ec683de5a\") " Jun 02 21:46:46.477085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.477061 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-bundle" (OuterVolumeSpecName: "bundle") pod "7ec1a0ab-336d-4678-a137-bc9ec683de5a" (UID: "7ec1a0ab-336d-4678-a137-bc9ec683de5a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:46.478657 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.478632 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ec1a0ab-336d-4678-a137-bc9ec683de5a-kube-api-access-q9gbh" (OuterVolumeSpecName: "kube-api-access-q9gbh") pod "7ec1a0ab-336d-4678-a137-bc9ec683de5a" (UID: "7ec1a0ab-336d-4678-a137-bc9ec683de5a"). InnerVolumeSpecName "kube-api-access-q9gbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:46:46.481771 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.481737 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-util" (OuterVolumeSpecName: "util") pod "7ec1a0ab-336d-4678-a137-bc9ec683de5a" (UID: "7ec1a0ab-336d-4678-a137-bc9ec683de5a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:46:46.577533 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.577492 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:46.577533 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.577526 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ec1a0ab-336d-4678-a137-bc9ec683de5a-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:46.577533 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:46.577538 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9gbh\" (UniqueName: \"kubernetes.io/projected/7ec1a0ab-336d-4678-a137-bc9ec683de5a-kube-api-access-q9gbh\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:46:47.180290 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:47.180247 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" event={"ID":"7ec1a0ab-336d-4678-a137-bc9ec683de5a","Type":"ContainerDied","Data":"89f878bed0cd7e30336217e9a38756c0310f54799632aef5828b991a034b364e"} Jun 02 21:46:47.180290 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:47.180290 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89f878bed0cd7e30336217e9a38756c0310f54799632aef5828b991a034b364e" Jun 02 21:46:47.180465 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:47.180330 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdrzs67" Jun 02 21:46:56.352055 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352018 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm"] Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352366 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="extract" Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352378 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="extract" Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352393 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="util" Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352398 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="util" Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352413 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="pull" Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352418 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="pull" Jun 02 21:46:56.352542 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.352467 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ec1a0ab-336d-4678-a137-bc9ec683de5a" containerName="extract" Jun 02 21:46:56.359273 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.359249 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.361731 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.361698 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 21:46:56.361865 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.361744 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 21:46:56.361865 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.361812 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kzbcq\"" Jun 02 21:46:56.361865 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.361842 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 21:46:56.362043 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.361877 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 21:46:56.367619 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.367597 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm"] Jun 02 21:46:56.455331 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.455296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9de808af-c628-4f2f-9a1d-35425ffc0bb3-tmp\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.455501 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.455337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9de808af-c628-4f2f-9a1d-35425ffc0bb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.455501 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.455452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9de808af-c628-4f2f-9a1d-35425ffc0bb3-manifests\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.455578 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.455518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxtxz\" (UniqueName: \"kubernetes.io/projected/9de808af-c628-4f2f-9a1d-35425ffc0bb3-kube-api-access-wxtxz\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.455578 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.455572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9de808af-c628-4f2f-9a1d-35425ffc0bb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.556613 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.556576 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9de808af-c628-4f2f-9a1d-35425ffc0bb3-tmp\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.556790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.556617 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9de808af-c628-4f2f-9a1d-35425ffc0bb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.556790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.556653 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9de808af-c628-4f2f-9a1d-35425ffc0bb3-manifests\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.556790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.556688 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxtxz\" (UniqueName: \"kubernetes.io/projected/9de808af-c628-4f2f-9a1d-35425ffc0bb3-kube-api-access-wxtxz\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.556790 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.556729 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9de808af-c628-4f2f-9a1d-35425ffc0bb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.557033 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.557010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9de808af-c628-4f2f-9a1d-35425ffc0bb3-manifests\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.558899 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.558866 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9de808af-c628-4f2f-9a1d-35425ffc0bb3-tmp\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.559044 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.559027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9de808af-c628-4f2f-9a1d-35425ffc0bb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.559085 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.559051 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9de808af-c628-4f2f-9a1d-35425ffc0bb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.565378 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.565355 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxtxz\" (UniqueName: \"kubernetes.io/projected/9de808af-c628-4f2f-9a1d-35425ffc0bb3-kube-api-access-wxtxz\") pod \"opendatahub-operator-controller-manager-6858789655-dnqzm\" (UID: \"9de808af-c628-4f2f-9a1d-35425ffc0bb3\") " pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.671052 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.670963 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:46:56.803268 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:56.803239 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm"] Jun 02 21:46:56.805934 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:46:56.805911 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de808af_c628_4f2f_9a1d_35425ffc0bb3.slice/crio-10d4ad9195bcc30aebd3743c29c89bbd6555f1ff5be01db57f4cd9b88debd3b6 WatchSource:0}: Error finding container 10d4ad9195bcc30aebd3743c29c89bbd6555f1ff5be01db57f4cd9b88debd3b6: Status 404 returned error can't find the container with id 10d4ad9195bcc30aebd3743c29c89bbd6555f1ff5be01db57f4cd9b88debd3b6 Jun 02 21:46:57.221844 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:46:57.221785 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" event={"ID":"9de808af-c628-4f2f-9a1d-35425ffc0bb3","Type":"ContainerStarted","Data":"10d4ad9195bcc30aebd3743c29c89bbd6555f1ff5be01db57f4cd9b88debd3b6"} Jun 02 21:47:00.234337 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:00.234255 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" event={"ID":"9de808af-c628-4f2f-9a1d-35425ffc0bb3","Type":"ContainerStarted","Data":"55775aebc6e64a2407efd661b5d0ab8ee212adf0fc09ec51a8dbac7076cd6d5c"} Jun 02 21:47:01.238716 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:01.238622 2565 generic.go:358] "Generic (PLEG): container finished" podID="9de808af-c628-4f2f-9a1d-35425ffc0bb3" containerID="55775aebc6e64a2407efd661b5d0ab8ee212adf0fc09ec51a8dbac7076cd6d5c" exitCode=0 Jun 02 21:47:01.239116 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:01.238717 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" event={"ID":"9de808af-c628-4f2f-9a1d-35425ffc0bb3","Type":"ContainerDied","Data":"55775aebc6e64a2407efd661b5d0ab8ee212adf0fc09ec51a8dbac7076cd6d5c"} Jun 02 21:47:02.243984 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:02.243942 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" event={"ID":"9de808af-c628-4f2f-9a1d-35425ffc0bb3","Type":"ContainerStarted","Data":"89e1fe9a63593741a6bb88c2bfce816e477af1c863e563877e15774bbbd9100b"} Jun 02 21:47:02.244472 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:02.244056 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:47:02.264694 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:02.264649 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" podStartSLOduration=1.405843707 podStartE2EDuration="6.264636647s" podCreationTimestamp="2026-06-02 21:46:56 +0000 UTC" firstStartedPulling="2026-06-02 21:46:56.808249996 +0000 UTC m=+336.206980829" lastFinishedPulling="2026-06-02 21:47:01.667042933 +0000 UTC m=+341.065773769" observedRunningTime="2026-06-02 21:47:02.263018838 +0000 UTC m=+341.661749693" watchObservedRunningTime="2026-06-02 21:47:02.264636647 +0000 UTC m=+341.663367501" Jun 02 21:47:13.249124 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:13.249090 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6858789655-dnqzm" Jun 02 21:47:15.236319 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.236282 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf"] Jun 02 21:47:15.244941 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.244914 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.247183 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.247136 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 21:47:15.247371 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.247146 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 21:47:15.248705 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.248679 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf"] Jun 02 21:47:15.299694 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.299659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f95740d-c183-46ff-b932-34497b278cba-tls-certs\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.299694 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.299695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qrx\" (UniqueName: \"kubernetes.io/projected/9f95740d-c183-46ff-b932-34497b278cba-kube-api-access-42qrx\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.299901 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.299722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f95740d-c183-46ff-b932-34497b278cba-tmp\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.400423 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.400391 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f95740d-c183-46ff-b932-34497b278cba-tls-certs\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.400423 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.400428 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42qrx\" (UniqueName: \"kubernetes.io/projected/9f95740d-c183-46ff-b932-34497b278cba-kube-api-access-42qrx\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.400645 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.400447 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f95740d-c183-46ff-b932-34497b278cba-tmp\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.400645 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:47:15.400553 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 02 21:47:15.400645 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:47:15.400625 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f95740d-c183-46ff-b932-34497b278cba-tls-certs podName:9f95740d-c183-46ff-b932-34497b278cba nodeName:}" failed. No retries permitted until 2026-06-02 21:47:15.900609889 +0000 UTC m=+355.299340722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9f95740d-c183-46ff-b932-34497b278cba-tls-certs") pod "kube-auth-proxy-7b495b9df5-qrtbf" (UID: "9f95740d-c183-46ff-b932-34497b278cba") : secret "kube-auth-proxy-tls" not found Jun 02 21:47:15.402705 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.402675 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f95740d-c183-46ff-b932-34497b278cba-tmp\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.410644 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.410623 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qrx\" (UniqueName: \"kubernetes.io/projected/9f95740d-c183-46ff-b932-34497b278cba-kube-api-access-42qrx\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.534910 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.534868 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-84z9b"] Jun 02 21:47:15.538416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.538396 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.540464 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.540443 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 21:47:15.540635 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.540545 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hxj7b\"" Jun 02 21:47:15.554727 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.554697 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-84z9b"] Jun 02 21:47:15.602588 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.602552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrxdc\" (UniqueName: \"kubernetes.io/projected/2e98be8c-3235-4184-a64a-fe1db2b7d954-kube-api-access-jrxdc\") pod \"odh-model-controller-76588b95-84z9b\" (UID: \"2e98be8c-3235-4184-a64a-fe1db2b7d954\") " pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.602776 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.602639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e98be8c-3235-4184-a64a-fe1db2b7d954-cert\") pod \"odh-model-controller-76588b95-84z9b\" (UID: \"2e98be8c-3235-4184-a64a-fe1db2b7d954\") " pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.703345 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.703302 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e98be8c-3235-4184-a64a-fe1db2b7d954-cert\") pod \"odh-model-controller-76588b95-84z9b\" (UID: \"2e98be8c-3235-4184-a64a-fe1db2b7d954\") " pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.703535 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.703446 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrxdc\" (UniqueName: \"kubernetes.io/projected/2e98be8c-3235-4184-a64a-fe1db2b7d954-kube-api-access-jrxdc\") pod \"odh-model-controller-76588b95-84z9b\" (UID: \"2e98be8c-3235-4184-a64a-fe1db2b7d954\") " pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.705977 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.705950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e98be8c-3235-4184-a64a-fe1db2b7d954-cert\") pod \"odh-model-controller-76588b95-84z9b\" (UID: \"2e98be8c-3235-4184-a64a-fe1db2b7d954\") " pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.711416 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.711388 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrxdc\" (UniqueName: \"kubernetes.io/projected/2e98be8c-3235-4184-a64a-fe1db2b7d954-kube-api-access-jrxdc\") pod \"odh-model-controller-76588b95-84z9b\" (UID: \"2e98be8c-3235-4184-a64a-fe1db2b7d954\") " pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.852294 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.852202 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:15.905791 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.905750 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f95740d-c183-46ff-b932-34497b278cba-tls-certs\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.908152 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.908125 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f95740d-c183-46ff-b932-34497b278cba-tls-certs\") pod \"kube-auth-proxy-7b495b9df5-qrtbf\" (UID: \"9f95740d-c183-46ff-b932-34497b278cba\") " pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:15.986583 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:15.986547 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-84z9b"] Jun 02 21:47:15.988949 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:15.988915 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e98be8c_3235_4184_a64a_fe1db2b7d954.slice/crio-e85d7cd8eda3cb40d0e100470e220682fad8c6ec8929dc26396746e2ce744f26 WatchSource:0}: Error finding container e85d7cd8eda3cb40d0e100470e220682fad8c6ec8929dc26396746e2ce744f26: Status 404 returned error can't find the container with id e85d7cd8eda3cb40d0e100470e220682fad8c6ec8929dc26396746e2ce744f26 Jun 02 21:47:16.037497 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.037463 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-nkfdh"] Jun 02 21:47:16.042777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.042756 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.044839 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.044821 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 21:47:16.048675 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.048652 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-nkfdh"] Jun 02 21:47:16.108187 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.108088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df323c12-a5e3-45c0-9e36-1516f13275b3-tls-certs\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.108337 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.108214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2tfp\" (UniqueName: \"kubernetes.io/projected/df323c12-a5e3-45c0-9e36-1516f13275b3-kube-api-access-x2tfp\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.156260 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.156232 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" Jun 02 21:47:16.209729 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.209662 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2tfp\" (UniqueName: \"kubernetes.io/projected/df323c12-a5e3-45c0-9e36-1516f13275b3-kube-api-access-x2tfp\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.209863 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.209728 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df323c12-a5e3-45c0-9e36-1516f13275b3-tls-certs\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.209943 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:47:16.209916 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 21:47:16.210002 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:47:16.209992 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df323c12-a5e3-45c0-9e36-1516f13275b3-tls-certs podName:df323c12-a5e3-45c0-9e36-1516f13275b3 nodeName:}" failed. No retries permitted until 2026-06-02 21:47:16.709968577 +0000 UTC m=+356.108699413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/df323c12-a5e3-45c0-9e36-1516f13275b3-tls-certs") pod "model-serving-api-6577596cd5-nkfdh" (UID: "df323c12-a5e3-45c0-9e36-1516f13275b3") : secret "model-serving-api-tls" not found Jun 02 21:47:16.219088 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.219034 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2tfp\" (UniqueName: \"kubernetes.io/projected/df323c12-a5e3-45c0-9e36-1516f13275b3-kube-api-access-x2tfp\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.292952 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.292917 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf"] Jun 02 21:47:16.293638 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.293606 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-84z9b" event={"ID":"2e98be8c-3235-4184-a64a-fe1db2b7d954","Type":"ContainerStarted","Data":"e85d7cd8eda3cb40d0e100470e220682fad8c6ec8929dc26396746e2ce744f26"} Jun 02 21:47:16.296144 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:16.296118 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f95740d_c183_46ff_b932_34497b278cba.slice/crio-ed9ae86b4f5c2a32c7da741f1a99c23cc9b7bc07dcb9146cf468f1fbb0a10bac WatchSource:0}: Error finding container ed9ae86b4f5c2a32c7da741f1a99c23cc9b7bc07dcb9146cf468f1fbb0a10bac: Status 404 returned error can't find the container with id ed9ae86b4f5c2a32c7da741f1a99c23cc9b7bc07dcb9146cf468f1fbb0a10bac Jun 02 21:47:16.714046 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.713911 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df323c12-a5e3-45c0-9e36-1516f13275b3-tls-certs\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.717983 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.717628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df323c12-a5e3-45c0-9e36-1516f13275b3-tls-certs\") pod \"model-serving-api-6577596cd5-nkfdh\" (UID: \"df323c12-a5e3-45c0-9e36-1516f13275b3\") " pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:16.957102 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:16.956567 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:17.143529 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.143490 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-nkfdh"] Jun 02 21:47:17.149300 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:17.149263 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf323c12_a5e3_45c0_9e36_1516f13275b3.slice/crio-8820cc423705c9222dad7524b134691f65e70f7768d3c58c1d628db4b0eb43fe WatchSource:0}: Error finding container 8820cc423705c9222dad7524b134691f65e70f7768d3c58c1d628db4b0eb43fe: Status 404 returned error can't find the container with id 8820cc423705c9222dad7524b134691f65e70f7768d3c58c1d628db4b0eb43fe Jun 02 21:47:17.221866 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.221828 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds"] Jun 02 21:47:17.227892 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.227207 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.230880 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.230858 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:47:17.231664 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.231638 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds"] Jun 02 21:47:17.233057 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.232830 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:47:17.233347 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.233313 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6fch\"" Jun 02 21:47:17.302266 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.302208 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" event={"ID":"9f95740d-c183-46ff-b932-34497b278cba","Type":"ContainerStarted","Data":"ed9ae86b4f5c2a32c7da741f1a99c23cc9b7bc07dcb9146cf468f1fbb0a10bac"} Jun 02 21:47:17.304179 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.304101 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" event={"ID":"df323c12-a5e3-45c0-9e36-1516f13275b3","Type":"ContainerStarted","Data":"8820cc423705c9222dad7524b134691f65e70f7768d3c58c1d628db4b0eb43fe"} Jun 02 21:47:17.319980 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.319952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnnbd\" (UniqueName: \"kubernetes.io/projected/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-kube-api-access-wnnbd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.320131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.320032 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.320131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.320063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.421494 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.421455 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.421681 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.421507 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.421681 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.421593 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnnbd\" (UniqueName: \"kubernetes.io/projected/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-kube-api-access-wnnbd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.422381 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.422354 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.422713 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.422652 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.429902 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.429875 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnnbd\" (UniqueName: \"kubernetes.io/projected/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-kube-api-access-wnnbd\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:17.544811 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:17.544364 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:20.375224 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:20.375195 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds"] Jun 02 21:47:20.622480 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:20.622452 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34450ddc_e4ee_4a59_8868_b4ddabfb9fc5.slice/crio-dcec28d1cdf1e333c1553d9f6e23f4099e8352e3631b9f6969f7d887ce53ad1f WatchSource:0}: Error finding container dcec28d1cdf1e333c1553d9f6e23f4099e8352e3631b9f6969f7d887ce53ad1f: Status 404 returned error can't find the container with id dcec28d1cdf1e333c1553d9f6e23f4099e8352e3631b9f6969f7d887ce53ad1f Jun 02 21:47:21.321653 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.321617 2565 generic.go:358] "Generic (PLEG): container finished" podID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerID="606fe2ae0e06d673183d54c9b00d69d556ae8ce920198b2f8907d9b4213796b2" exitCode=0 Jun 02 21:47:21.321842 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.321691 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" event={"ID":"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5","Type":"ContainerDied","Data":"606fe2ae0e06d673183d54c9b00d69d556ae8ce920198b2f8907d9b4213796b2"} Jun 02 21:47:21.321842 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.321737 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" event={"ID":"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5","Type":"ContainerStarted","Data":"dcec28d1cdf1e333c1553d9f6e23f4099e8352e3631b9f6969f7d887ce53ad1f"} Jun 02 21:47:21.323177 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.323127 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" event={"ID":"df323c12-a5e3-45c0-9e36-1516f13275b3","Type":"ContainerStarted","Data":"848c062531e70a78ac2c98fa9106285dbc72050c983a13ca73f8074554a961dc"} Jun 02 21:47:21.323384 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.323297 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:21.324497 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.324462 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-84z9b" event={"ID":"2e98be8c-3235-4184-a64a-fe1db2b7d954","Type":"ContainerStarted","Data":"57f3bc4e647b7a828d0abc90047c94b01d8dbbc3a24321f4ab28de8dd21e44ac"} Jun 02 21:47:21.324662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.324590 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:21.325906 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.325883 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" event={"ID":"9f95740d-c183-46ff-b932-34497b278cba","Type":"ContainerStarted","Data":"9bf08ad27d77a2845ddb6f353356aa5367ae257263f9e1b064f422d5c6e98678"} Jun 02 21:47:21.351774 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.351731 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b495b9df5-qrtbf" podStartSLOduration=1.987994383 podStartE2EDuration="6.351718753s" podCreationTimestamp="2026-06-02 21:47:15 +0000 UTC" firstStartedPulling="2026-06-02 21:47:16.297668811 +0000 UTC m=+355.696399643" lastFinishedPulling="2026-06-02 21:47:20.661393179 +0000 UTC m=+360.060124013" observedRunningTime="2026-06-02 21:47:21.349675668 +0000 UTC m=+360.748406524" watchObservedRunningTime="2026-06-02 21:47:21.351718753 +0000 UTC m=+360.750449607" Jun 02 21:47:21.365114 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.365077 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-84z9b" podStartSLOduration=1.760309151 podStartE2EDuration="6.365063939s" podCreationTimestamp="2026-06-02 21:47:15 +0000 UTC" firstStartedPulling="2026-06-02 21:47:15.990209802 +0000 UTC m=+355.388940634" lastFinishedPulling="2026-06-02 21:47:20.594964585 +0000 UTC m=+359.993695422" observedRunningTime="2026-06-02 21:47:21.363263135 +0000 UTC m=+360.761994000" watchObservedRunningTime="2026-06-02 21:47:21.365063939 +0000 UTC m=+360.763794794" Jun 02 21:47:21.381957 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:21.381912 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" podStartSLOduration=1.8773051189999999 podStartE2EDuration="5.381900573s" podCreationTimestamp="2026-06-02 21:47:16 +0000 UTC" firstStartedPulling="2026-06-02 21:47:17.151419553 +0000 UTC m=+356.550150401" lastFinishedPulling="2026-06-02 21:47:20.656015008 +0000 UTC m=+360.054745855" observedRunningTime="2026-06-02 21:47:21.379910319 +0000 UTC m=+360.778641173" watchObservedRunningTime="2026-06-02 21:47:21.381900573 +0000 UTC m=+360.780631427" Jun 02 21:47:22.331104 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:22.331072 2565 generic.go:358] "Generic (PLEG): container finished" podID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerID="87e41d19a07f07a6b2a37dad4de0d72fbe9da5ca35e4d2605e75d4a1e877ab53" exitCode=0 Jun 02 21:47:22.331304 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:22.331153 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" event={"ID":"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5","Type":"ContainerDied","Data":"87e41d19a07f07a6b2a37dad4de0d72fbe9da5ca35e4d2605e75d4a1e877ab53"} Jun 02 21:47:23.337721 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:23.337680 2565 generic.go:358] "Generic (PLEG): container finished" podID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerID="43c51bed8411525ba632849ce8d315318cbee67dda4a15d2e47987c385d92d85" exitCode=0 Jun 02 21:47:23.338115 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:23.337746 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" event={"ID":"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5","Type":"ContainerDied","Data":"43c51bed8411525ba632849ce8d315318cbee67dda4a15d2e47987c385d92d85"} Jun 02 21:47:24.463956 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.463932 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:24.588745 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.588709 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-bundle\") pod \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " Jun 02 21:47:24.588905 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.588752 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnnbd\" (UniqueName: \"kubernetes.io/projected/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-kube-api-access-wnnbd\") pod \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " Jun 02 21:47:24.588905 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.588883 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-util\") pod \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\" (UID: \"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5\") " Jun 02 21:47:24.589656 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.589632 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-bundle" (OuterVolumeSpecName: "bundle") pod "34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" (UID: "34450ddc-e4ee-4a59-8868-b4ddabfb9fc5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:47:24.590947 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.590915 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-kube-api-access-wnnbd" (OuterVolumeSpecName: "kube-api-access-wnnbd") pod "34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" (UID: "34450ddc-e4ee-4a59-8868-b4ddabfb9fc5"). InnerVolumeSpecName "kube-api-access-wnnbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:47:24.594804 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.594752 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-util" (OuterVolumeSpecName: "util") pod "34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" (UID: "34450ddc-e4ee-4a59-8868-b4ddabfb9fc5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:47:24.690525 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.690480 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:47:24.690525 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.690524 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnnbd\" (UniqueName: \"kubernetes.io/projected/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-kube-api-access-wnnbd\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:47:24.690737 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:24.690539 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/34450ddc-e4ee-4a59-8868-b4ddabfb9fc5-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:47:25.347215 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.347189 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" Jun 02 21:47:25.347407 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.347186 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48357pzds" event={"ID":"34450ddc-e4ee-4a59-8868-b4ddabfb9fc5","Type":"ContainerDied","Data":"dcec28d1cdf1e333c1553d9f6e23f4099e8352e3631b9f6969f7d887ce53ad1f"} Jun 02 21:47:25.347407 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.347295 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcec28d1cdf1e333c1553d9f6e23f4099e8352e3631b9f6969f7d887ce53ad1f" Jun 02 21:47:25.354439 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354418 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85"] Jun 02 21:47:25.354738 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354727 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="util" Jun 02 21:47:25.354777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354740 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="util" Jun 02 21:47:25.354777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354753 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="pull" Jun 02 21:47:25.354777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354759 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="pull" Jun 02 21:47:25.354777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354769 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="extract" Jun 02 21:47:25.354777 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354774 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="extract" Jun 02 21:47:25.354920 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.354839 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="34450ddc-e4ee-4a59-8868-b4ddabfb9fc5" containerName="extract" Jun 02 21:47:25.358863 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.358845 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.361846 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.361678 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 21:47:25.362024 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.362006 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2mpvt\"" Jun 02 21:47:25.363373 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.363346 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw"] Jun 02 21:47:25.367213 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.366771 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.367791 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.367286 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85"] Jun 02 21:47:25.368965 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.368904 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 21:47:25.368965 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.368930 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zrswb\"" Jun 02 21:47:25.376594 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.376570 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw"] Jun 02 21:47:25.497927 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.497890 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9a641bd-4bc5-4de8-8b51-f335e1aaf84f-cert\") pod \"kserve-controller-manager-7c99ffcdcd-tsr85\" (UID: \"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.498349 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.497968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqrx9\" (UniqueName: \"kubernetes.io/projected/a9a641bd-4bc5-4de8-8b51-f335e1aaf84f-kube-api-access-gqrx9\") pod \"kserve-controller-manager-7c99ffcdcd-tsr85\" (UID: \"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.498349 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.498002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7c84f4d-b760-47b8-9070-773409565970-cert\") pod \"llmisvc-controller-manager-c6b9847d7-sj2mw\" (UID: \"a7c84f4d-b760-47b8-9070-773409565970\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.498349 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.498036 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8dn\" (UniqueName: \"kubernetes.io/projected/a7c84f4d-b760-47b8-9070-773409565970-kube-api-access-4n8dn\") pod \"llmisvc-controller-manager-c6b9847d7-sj2mw\" (UID: \"a7c84f4d-b760-47b8-9070-773409565970\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.598918 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.598883 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7c84f4d-b760-47b8-9070-773409565970-cert\") pod \"llmisvc-controller-manager-c6b9847d7-sj2mw\" (UID: \"a7c84f4d-b760-47b8-9070-773409565970\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.599070 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.599016 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8dn\" (UniqueName: \"kubernetes.io/projected/a7c84f4d-b760-47b8-9070-773409565970-kube-api-access-4n8dn\") pod \"llmisvc-controller-manager-c6b9847d7-sj2mw\" (UID: \"a7c84f4d-b760-47b8-9070-773409565970\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.599070 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.599062 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9a641bd-4bc5-4de8-8b51-f335e1aaf84f-cert\") pod \"kserve-controller-manager-7c99ffcdcd-tsr85\" (UID: \"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.599153 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.599112 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gqrx9\" (UniqueName: \"kubernetes.io/projected/a9a641bd-4bc5-4de8-8b51-f335e1aaf84f-kube-api-access-gqrx9\") pod \"kserve-controller-manager-7c99ffcdcd-tsr85\" (UID: \"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.601303 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.601280 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a7c84f4d-b760-47b8-9070-773409565970-cert\") pod \"llmisvc-controller-manager-c6b9847d7-sj2mw\" (UID: \"a7c84f4d-b760-47b8-9070-773409565970\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.601512 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.601491 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9a641bd-4bc5-4de8-8b51-f335e1aaf84f-cert\") pod \"kserve-controller-manager-7c99ffcdcd-tsr85\" (UID: \"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.616079 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.616049 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8dn\" (UniqueName: \"kubernetes.io/projected/a7c84f4d-b760-47b8-9070-773409565970-kube-api-access-4n8dn\") pod \"llmisvc-controller-manager-c6b9847d7-sj2mw\" (UID: \"a7c84f4d-b760-47b8-9070-773409565970\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.616262 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.616244 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqrx9\" (UniqueName: \"kubernetes.io/projected/a9a641bd-4bc5-4de8-8b51-f335e1aaf84f-kube-api-access-gqrx9\") pod \"kserve-controller-manager-7c99ffcdcd-tsr85\" (UID: \"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.671672 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.671610 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:25.682340 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.682315 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:25.830191 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.829955 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85"] Jun 02 21:47:25.832446 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:25.832412 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9a641bd_4bc5_4de8_8b51_f335e1aaf84f.slice/crio-3bdd9de2a00d5b8ea0b8d5d089aa002ef20699654db1ba1cc1801bcf3497db16 WatchSource:0}: Error finding container 3bdd9de2a00d5b8ea0b8d5d089aa002ef20699654db1ba1cc1801bcf3497db16: Status 404 returned error can't find the container with id 3bdd9de2a00d5b8ea0b8d5d089aa002ef20699654db1ba1cc1801bcf3497db16 Jun 02 21:47:25.849732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:25.849709 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw"] Jun 02 21:47:25.851263 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:25.851239 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda7c84f4d_b760_47b8_9070_773409565970.slice/crio-67a3979114dd9f6a04cdf17b8c04b7802dd3a9dccecebcd11dedd92c9eeaa7f1 WatchSource:0}: Error finding container 67a3979114dd9f6a04cdf17b8c04b7802dd3a9dccecebcd11dedd92c9eeaa7f1: Status 404 returned error can't find the container with id 67a3979114dd9f6a04cdf17b8c04b7802dd3a9dccecebcd11dedd92c9eeaa7f1 Jun 02 21:47:26.352096 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:26.352060 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" event={"ID":"a7c84f4d-b760-47b8-9070-773409565970","Type":"ContainerStarted","Data":"67a3979114dd9f6a04cdf17b8c04b7802dd3a9dccecebcd11dedd92c9eeaa7f1"} Jun 02 21:47:26.353100 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:26.353072 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" event={"ID":"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f","Type":"ContainerStarted","Data":"3bdd9de2a00d5b8ea0b8d5d089aa002ef20699654db1ba1cc1801bcf3497db16"} Jun 02 21:47:29.365089 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:29.365045 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" event={"ID":"a7c84f4d-b760-47b8-9070-773409565970","Type":"ContainerStarted","Data":"f5b182b4a26add85f53d96f760df9067d7dee2fc53f4f32e1f78a27dda601eda"} Jun 02 21:47:29.365558 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:29.365125 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:47:29.366404 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:29.366378 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" event={"ID":"a9a641bd-4bc5-4de8-8b51-f335e1aaf84f","Type":"ContainerStarted","Data":"b36492d89e858943abd6abcfd8e836edfaa0ff648c9a2b5c3e5071ddd1650cc4"} Jun 02 21:47:29.366486 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:29.366477 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:47:29.381083 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:29.381041 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" podStartSLOduration=1.30107654 podStartE2EDuration="4.381029803s" podCreationTimestamp="2026-06-02 21:47:25 +0000 UTC" firstStartedPulling="2026-06-02 21:47:25.852518738 +0000 UTC m=+365.251249571" lastFinishedPulling="2026-06-02 21:47:28.932472 +0000 UTC m=+368.331202834" observedRunningTime="2026-06-02 21:47:29.379137315 +0000 UTC m=+368.777868171" watchObservedRunningTime="2026-06-02 21:47:29.381029803 +0000 UTC m=+368.779760657" Jun 02 21:47:29.393947 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:29.393903 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" podStartSLOduration=1.298857277 podStartE2EDuration="4.393888153s" podCreationTimestamp="2026-06-02 21:47:25 +0000 UTC" firstStartedPulling="2026-06-02 21:47:25.833719744 +0000 UTC m=+365.232450581" lastFinishedPulling="2026-06-02 21:47:28.928750611 +0000 UTC m=+368.327481457" observedRunningTime="2026-06-02 21:47:29.393401507 +0000 UTC m=+368.792132362" watchObservedRunningTime="2026-06-02 21:47:29.393888153 +0000 UTC m=+368.792619009" Jun 02 21:47:31.789569 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.789540 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x"] Jun 02 21:47:31.792245 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.792222 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.794957 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.794935 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:47:31.795750 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.795729 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6fch\"" Jun 02 21:47:31.795847 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.795817 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:47:31.804196 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.804144 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x"] Jun 02 21:47:31.858023 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.857978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.858225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.858037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.858225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.858113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njxg7\" (UniqueName: \"kubernetes.io/projected/72635229-ac2e-4b22-bf7e-d503e151c4af-kube-api-access-njxg7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.959389 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.959321 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njxg7\" (UniqueName: \"kubernetes.io/projected/72635229-ac2e-4b22-bf7e-d503e151c4af-kube-api-access-njxg7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.959602 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.959432 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.959602 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.959468 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.959813 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.959793 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.959871 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.959854 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:31.969724 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:31.969697 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njxg7\" (UniqueName: \"kubernetes.io/projected/72635229-ac2e-4b22-bf7e-d503e151c4af-kube-api-access-njxg7\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:32.103449 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:32.103366 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:32.272532 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:32.272502 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x"] Jun 02 21:47:32.273984 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:32.273955 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72635229_ac2e_4b22_bf7e_d503e151c4af.slice/crio-07d0c491e62beb64d3518da36656b66c6a4bb2ade7bd85085753ae9a3ee3ab47 WatchSource:0}: Error finding container 07d0c491e62beb64d3518da36656b66c6a4bb2ade7bd85085753ae9a3ee3ab47: Status 404 returned error can't find the container with id 07d0c491e62beb64d3518da36656b66c6a4bb2ade7bd85085753ae9a3ee3ab47 Jun 02 21:47:32.333546 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:32.333524 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-84z9b" Jun 02 21:47:32.337480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:32.337459 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-nkfdh" Jun 02 21:47:32.380456 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:32.380423 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" event={"ID":"72635229-ac2e-4b22-bf7e-d503e151c4af","Type":"ContainerStarted","Data":"669a169f347c63344519b67b4d1f4d1b1a9dbbc304756407f476106ddf591a92"} Jun 02 21:47:32.380571 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:32.380465 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" event={"ID":"72635229-ac2e-4b22-bf7e-d503e151c4af","Type":"ContainerStarted","Data":"07d0c491e62beb64d3518da36656b66c6a4bb2ade7bd85085753ae9a3ee3ab47"} Jun 02 21:47:33.074607 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.074574 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm"] Jun 02 21:47:33.077796 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.077776 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.080092 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.080071 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 21:47:33.080225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.080138 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 21:47:33.080225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.080217 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-svbq8\"" Jun 02 21:47:33.089406 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.089381 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm"] Jun 02 21:47:33.170609 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.170562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9e509c7e-a497-4bb4-9475-64c3094fb216-operator-config\") pod \"servicemesh-operator3-55f49c5f94-ctpmm\" (UID: \"9e509c7e-a497-4bb4-9475-64c3094fb216\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.170783 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.170636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfwdr\" (UniqueName: \"kubernetes.io/projected/9e509c7e-a497-4bb4-9475-64c3094fb216-kube-api-access-mfwdr\") pod \"servicemesh-operator3-55f49c5f94-ctpmm\" (UID: \"9e509c7e-a497-4bb4-9475-64c3094fb216\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.271727 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.271691 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9e509c7e-a497-4bb4-9475-64c3094fb216-operator-config\") pod \"servicemesh-operator3-55f49c5f94-ctpmm\" (UID: \"9e509c7e-a497-4bb4-9475-64c3094fb216\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.271906 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.271837 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfwdr\" (UniqueName: \"kubernetes.io/projected/9e509c7e-a497-4bb4-9475-64c3094fb216-kube-api-access-mfwdr\") pod \"servicemesh-operator3-55f49c5f94-ctpmm\" (UID: \"9e509c7e-a497-4bb4-9475-64c3094fb216\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.274376 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.274343 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9e509c7e-a497-4bb4-9475-64c3094fb216-operator-config\") pod \"servicemesh-operator3-55f49c5f94-ctpmm\" (UID: \"9e509c7e-a497-4bb4-9475-64c3094fb216\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.279832 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.279805 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfwdr\" (UniqueName: \"kubernetes.io/projected/9e509c7e-a497-4bb4-9475-64c3094fb216-kube-api-access-mfwdr\") pod \"servicemesh-operator3-55f49c5f94-ctpmm\" (UID: \"9e509c7e-a497-4bb4-9475-64c3094fb216\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.385024 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.384989 2565 generic.go:358] "Generic (PLEG): container finished" podID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerID="669a169f347c63344519b67b4d1f4d1b1a9dbbc304756407f476106ddf591a92" exitCode=0 Jun 02 21:47:33.385209 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.385075 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" event={"ID":"72635229-ac2e-4b22-bf7e-d503e151c4af","Type":"ContainerDied","Data":"669a169f347c63344519b67b4d1f4d1b1a9dbbc304756407f476106ddf591a92"} Jun 02 21:47:33.386419 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.386347 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:33.567426 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:33.567400 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm"] Jun 02 21:47:33.569284 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:33.569261 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e509c7e_a497_4bb4_9475_64c3094fb216.slice/crio-cd837e511ffe37892aa9633a4159f4c4794452f43eb2c93e65a93810d8a6e906 WatchSource:0}: Error finding container cd837e511ffe37892aa9633a4159f4c4794452f43eb2c93e65a93810d8a6e906: Status 404 returned error can't find the container with id cd837e511ffe37892aa9633a4159f4c4794452f43eb2c93e65a93810d8a6e906 Jun 02 21:47:34.391385 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:34.391286 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" event={"ID":"9e509c7e-a497-4bb4-9475-64c3094fb216","Type":"ContainerStarted","Data":"cd837e511ffe37892aa9633a4159f4c4794452f43eb2c93e65a93810d8a6e906"} Jun 02 21:47:34.393567 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:34.393535 2565 generic.go:358] "Generic (PLEG): container finished" podID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerID="fc99dede2f34828edfa9352bd0ad65f62353b80672ece2a016c0fdeb4d355912" exitCode=0 Jun 02 21:47:34.393698 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:34.393627 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" event={"ID":"72635229-ac2e-4b22-bf7e-d503e151c4af","Type":"ContainerDied","Data":"fc99dede2f34828edfa9352bd0ad65f62353b80672ece2a016c0fdeb4d355912"} Jun 02 21:47:35.399644 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:35.399605 2565 generic.go:358] "Generic (PLEG): container finished" podID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerID="ea051d112717f3b49ccf46a11a3faecb081da2d98464d4a162907cfe9a45255c" exitCode=0 Jun 02 21:47:35.400093 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:35.399695 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" event={"ID":"72635229-ac2e-4b22-bf7e-d503e151c4af","Type":"ContainerDied","Data":"ea051d112717f3b49ccf46a11a3faecb081da2d98464d4a162907cfe9a45255c"} Jun 02 21:47:36.405381 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.405341 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" event={"ID":"9e509c7e-a497-4bb4-9475-64c3094fb216","Type":"ContainerStarted","Data":"34015b4ebfca53b28b2bbefd62921d25957190e0cb63ab86d8197f1c9639091e"} Jun 02 21:47:36.405830 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.405644 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:36.428631 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.428570 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" podStartSLOduration=1.082572477 podStartE2EDuration="3.428551418s" podCreationTimestamp="2026-06-02 21:47:33 +0000 UTC" firstStartedPulling="2026-06-02 21:47:33.571826134 +0000 UTC m=+372.970556968" lastFinishedPulling="2026-06-02 21:47:35.917805062 +0000 UTC m=+375.316535909" observedRunningTime="2026-06-02 21:47:36.424806707 +0000 UTC m=+375.823537562" watchObservedRunningTime="2026-06-02 21:47:36.428551418 +0000 UTC m=+375.827282274" Jun 02 21:47:36.536130 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.536107 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:36.702448 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.702350 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-bundle\") pod \"72635229-ac2e-4b22-bf7e-d503e151c4af\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " Jun 02 21:47:36.702448 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.702412 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-util\") pod \"72635229-ac2e-4b22-bf7e-d503e151c4af\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " Jun 02 21:47:36.702448 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.702449 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njxg7\" (UniqueName: \"kubernetes.io/projected/72635229-ac2e-4b22-bf7e-d503e151c4af-kube-api-access-njxg7\") pod \"72635229-ac2e-4b22-bf7e-d503e151c4af\" (UID: \"72635229-ac2e-4b22-bf7e-d503e151c4af\") " Jun 02 21:47:36.703322 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.703292 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-bundle" (OuterVolumeSpecName: "bundle") pod "72635229-ac2e-4b22-bf7e-d503e151c4af" (UID: "72635229-ac2e-4b22-bf7e-d503e151c4af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:47:36.704544 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.704520 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72635229-ac2e-4b22-bf7e-d503e151c4af-kube-api-access-njxg7" (OuterVolumeSpecName: "kube-api-access-njxg7") pod "72635229-ac2e-4b22-bf7e-d503e151c4af" (UID: "72635229-ac2e-4b22-bf7e-d503e151c4af"). InnerVolumeSpecName "kube-api-access-njxg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:47:36.706988 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.706947 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-util" (OuterVolumeSpecName: "util") pod "72635229-ac2e-4b22-bf7e-d503e151c4af" (UID: "72635229-ac2e-4b22-bf7e-d503e151c4af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:47:36.803411 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.803368 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:47:36.803411 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.803405 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72635229-ac2e-4b22-bf7e-d503e151c4af-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:47:36.803615 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:36.803423 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njxg7\" (UniqueName: \"kubernetes.io/projected/72635229-ac2e-4b22-bf7e-d503e151c4af-kube-api-access-njxg7\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:47:37.410629 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:37.410534 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" event={"ID":"72635229-ac2e-4b22-bf7e-d503e151c4af","Type":"ContainerDied","Data":"07d0c491e62beb64d3518da36656b66c6a4bb2ade7bd85085753ae9a3ee3ab47"} Jun 02 21:47:37.410629 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:37.410579 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07d0c491e62beb64d3518da36656b66c6a4bb2ade7bd85085753ae9a3ee3ab47" Jun 02 21:47:37.410629 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:37.410553 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a9n77x" Jun 02 21:47:45.518500 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518437 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-659c675bb5-fm96x"] Jun 02 21:47:45.519007 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518928 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="extract" Jun 02 21:47:45.519007 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518945 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="extract" Jun 02 21:47:45.519007 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518956 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="util" Jun 02 21:47:45.519007 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518961 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="util" Jun 02 21:47:45.519007 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518975 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="pull" Jun 02 21:47:45.519007 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.518981 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="pull" Jun 02 21:47:45.519358 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.519039 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="72635229-ac2e-4b22-bf7e-d503e151c4af" containerName="extract" Jun 02 21:47:45.521681 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.521657 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.523997 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.523977 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 21:47:45.524121 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.524104 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tpp75\"" Jun 02 21:47:45.528047 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.528025 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-659c675bb5-fm96x"] Jun 02 21:47:45.673611 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.673571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/551545a7-e23a-4ca0-9e3c-ad3b831f8f3b-redirect-config\") pod \"dashboard-redirect-659c675bb5-fm96x\" (UID: \"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b\") " pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.673611 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.673616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jkgl\" (UniqueName: \"kubernetes.io/projected/551545a7-e23a-4ca0-9e3c-ad3b831f8f3b-kube-api-access-2jkgl\") pod \"dashboard-redirect-659c675bb5-fm96x\" (UID: \"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b\") " pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.774430 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.774339 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/551545a7-e23a-4ca0-9e3c-ad3b831f8f3b-redirect-config\") pod \"dashboard-redirect-659c675bb5-fm96x\" (UID: \"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b\") " pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.774430 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.774382 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jkgl\" (UniqueName: \"kubernetes.io/projected/551545a7-e23a-4ca0-9e3c-ad3b831f8f3b-kube-api-access-2jkgl\") pod \"dashboard-redirect-659c675bb5-fm96x\" (UID: \"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b\") " pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.775144 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.775123 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/551545a7-e23a-4ca0-9e3c-ad3b831f8f3b-redirect-config\") pod \"dashboard-redirect-659c675bb5-fm96x\" (UID: \"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b\") " pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.782458 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.782427 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jkgl\" (UniqueName: \"kubernetes.io/projected/551545a7-e23a-4ca0-9e3c-ad3b831f8f3b-kube-api-access-2jkgl\") pod \"dashboard-redirect-659c675bb5-fm96x\" (UID: \"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b\") " pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.834470 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.834421 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" Jun 02 21:47:45.975157 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:45.975123 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-659c675bb5-fm96x"] Jun 02 21:47:45.976949 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:47:45.976921 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551545a7_e23a_4ca0_9e3c_ad3b831f8f3b.slice/crio-66336d28db1bd632ebca78520b742be01118fd0f2591252cf71aef994032c81d WatchSource:0}: Error finding container 66336d28db1bd632ebca78520b742be01118fd0f2591252cf71aef994032c81d: Status 404 returned error can't find the container with id 66336d28db1bd632ebca78520b742be01118fd0f2591252cf71aef994032c81d Jun 02 21:47:46.443809 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:46.443769 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" event={"ID":"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b","Type":"ContainerStarted","Data":"66336d28db1bd632ebca78520b742be01118fd0f2591252cf71aef994032c81d"} Jun 02 21:47:47.413591 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:47.413555 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-ctpmm" Jun 02 21:47:48.452506 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:48.452470 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" event={"ID":"551545a7-e23a-4ca0-9e3c-ad3b831f8f3b","Type":"ContainerStarted","Data":"ed46f01625cbd88c3296d72ba75bbadb58d5f1357f04abf905f32e0398cf58bd"} Jun 02 21:47:48.477014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:47:48.476929 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-659c675bb5-fm96x" podStartSLOduration=1.23173034 podStartE2EDuration="3.476914376s" podCreationTimestamp="2026-06-02 21:47:45 +0000 UTC" firstStartedPulling="2026-06-02 21:47:45.978281029 +0000 UTC m=+385.377011863" lastFinishedPulling="2026-06-02 21:47:48.223465061 +0000 UTC m=+387.622195899" observedRunningTime="2026-06-02 21:47:48.476406955 +0000 UTC m=+387.875137809" watchObservedRunningTime="2026-06-02 21:47:48.476914376 +0000 UTC m=+387.875645232" Jun 02 21:48:00.372793 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:00.372762 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-sj2mw" Jun 02 21:48:00.375673 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:00.375650 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tsr85" Jun 02 21:48:03.981888 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.981821 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9"] Jun 02 21:48:03.985552 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.985532 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:03.988372 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.988343 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 21:48:03.988372 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.988346 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 21:48:03.988543 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.988384 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 21:48:03.988641 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.988626 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 21:48:03.988690 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.988674 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r479j\"" Jun 02 21:48:03.998868 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:03.998846 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9"] Jun 02 21:48:04.032666 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02fc461e-037b-4a99-829f-90a20b68c25c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.032666 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02fc461e-037b-4a99-829f-90a20b68c25c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.032852 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.032852 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5g8\" (UniqueName: \"kubernetes.io/projected/02fc461e-037b-4a99-829f-90a20b68c25c-kube-api-access-rc5g8\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.032852 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.032972 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02fc461e-037b-4a99-829f-90a20b68c25c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.032972 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.032904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.133662 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133627 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.133809 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133669 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02fc461e-037b-4a99-829f-90a20b68c25c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.133809 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133698 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.133809 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133744 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02fc461e-037b-4a99-829f-90a20b68c25c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.133809 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133763 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02fc461e-037b-4a99-829f-90a20b68c25c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.133809 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133801 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.134036 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.133840 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5g8\" (UniqueName: \"kubernetes.io/projected/02fc461e-037b-4a99-829f-90a20b68c25c-kube-api-access-rc5g8\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.134562 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.134529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/02fc461e-037b-4a99-829f-90a20b68c25c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.136282 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.136258 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.136400 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.136290 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.136468 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.136398 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/02fc461e-037b-4a99-829f-90a20b68c25c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.136627 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.136574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/02fc461e-037b-4a99-829f-90a20b68c25c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.141488 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.141459 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02fc461e-037b-4a99-829f-90a20b68c25c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.145333 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.145310 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5g8\" (UniqueName: \"kubernetes.io/projected/02fc461e-037b-4a99-829f-90a20b68c25c-kube-api-access-rc5g8\") pod \"istiod-openshift-gateway-798958bb55-q5ft9\" (UID: \"02fc461e-037b-4a99-829f-90a20b68c25c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.295221 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.295180 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:04.434475 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.434446 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9"] Jun 02 21:48:04.437054 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:48:04.437024 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fc461e_037b_4a99_829f_90a20b68c25c.slice/crio-b1c798ca8769cd59a794ec14801e1e2ca76df47bad649f66db3987bd75dcf993 WatchSource:0}: Error finding container b1c798ca8769cd59a794ec14801e1e2ca76df47bad649f66db3987bd75dcf993: Status 404 returned error can't find the container with id b1c798ca8769cd59a794ec14801e1e2ca76df47bad649f66db3987bd75dcf993 Jun 02 21:48:04.515779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:04.515745 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" event={"ID":"02fc461e-037b-4a99-829f-90a20b68c25c","Type":"ContainerStarted","Data":"b1c798ca8769cd59a794ec14801e1e2ca76df47bad649f66db3987bd75dcf993"} Jun 02 21:48:07.043264 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:07.043225 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 21:48:07.043617 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:07.043289 2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 21:48:07.530131 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:07.530093 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" event={"ID":"02fc461e-037b-4a99-829f-90a20b68c25c","Type":"ContainerStarted","Data":"8cc6ec0133d3975e49bf3648663e8bd20d9474b3a32b0b9b20402dedfb71ebd0"} Jun 02 21:48:07.530354 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:07.530149 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:07.549799 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:07.549749 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" podStartSLOduration=1.9461442949999999 podStartE2EDuration="4.549732963s" podCreationTimestamp="2026-06-02 21:48:03 +0000 UTC" firstStartedPulling="2026-06-02 21:48:04.439355076 +0000 UTC m=+403.838085919" lastFinishedPulling="2026-06-02 21:48:07.042943739 +0000 UTC m=+406.441674587" observedRunningTime="2026-06-02 21:48:07.547057516 +0000 UTC m=+406.945788370" watchObservedRunningTime="2026-06-02 21:48:07.549732963 +0000 UTC m=+406.948463818" Jun 02 21:48:08.536744 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:08.536714 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-q5ft9" Jun 02 21:48:32.296004 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.295900 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8"] Jun 02 21:48:32.299435 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.299413 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.301990 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.301969 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hfbzz\"" Jun 02 21:48:32.302098 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.301987 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:48:32.302769 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.302755 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:48:32.307762 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.307733 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8"] Jun 02 21:48:32.389862 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.389825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.390060 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.389879 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjb4\" (UniqueName: \"kubernetes.io/projected/2db9cf89-3e74-4966-9137-889c3ac3b418-kube-api-access-7hjb4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.390060 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.389912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.490565 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.490522 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.490734 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.490584 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjb4\" (UniqueName: \"kubernetes.io/projected/2db9cf89-3e74-4966-9137-889c3ac3b418-kube-api-access-7hjb4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.490734 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.490613 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.490966 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.490942 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.491032 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.490971 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.499386 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.499358 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjb4\" (UniqueName: \"kubernetes.io/projected/2db9cf89-3e74-4966-9137-889c3ac3b418-kube-api-access-7hjb4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.610433 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.610337 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:32.707314 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.707264 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd"] Jun 02 21:48:32.716950 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.716918 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd"] Jun 02 21:48:32.717157 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.717047 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.751949 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.751764 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8"] Jun 02 21:48:32.754323 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:48:32.754298 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2db9cf89_3e74_4966_9137_889c3ac3b418.slice/crio-83ea3769960b0d1c8b12d7610a410a2719005347fd91d90999d78118d9a856d2 WatchSource:0}: Error finding container 83ea3769960b0d1c8b12d7610a410a2719005347fd91d90999d78118d9a856d2: Status 404 returned error can't find the container with id 83ea3769960b0d1c8b12d7610a410a2719005347fd91d90999d78118d9a856d2 Jun 02 21:48:32.794024 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.793986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.794225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.794049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9fb5\" (UniqueName: \"kubernetes.io/projected/549474fd-3074-4ec1-9119-9734296b4261-kube-api-access-m9fb5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.794225 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.794101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.895534 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.895481 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9fb5\" (UniqueName: \"kubernetes.io/projected/549474fd-3074-4ec1-9119-9734296b4261-kube-api-access-m9fb5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.895534 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.895538 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.895756 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.895624 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.895922 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.895900 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.895963 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.895928 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:32.903600 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:32.903571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9fb5\" (UniqueName: \"kubernetes.io/projected/549474fd-3074-4ec1-9119-9734296b4261-kube-api-access-m9fb5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:33.031887 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.031853 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:33.096959 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.096923 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt"] Jun 02 21:48:33.101872 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.101848 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.111111 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.111018 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt"] Jun 02 21:48:33.169774 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.169748 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd"] Jun 02 21:48:33.171884 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:48:33.171856 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549474fd_3074_4ec1_9119_9734296b4261.slice/crio-74573f9a54bb810262dc3278e6bf7189abcd008381a6af36c90010d3a8e241f1 WatchSource:0}: Error finding container 74573f9a54bb810262dc3278e6bf7189abcd008381a6af36c90010d3a8e241f1: Status 404 returned error can't find the container with id 74573f9a54bb810262dc3278e6bf7189abcd008381a6af36c90010d3a8e241f1 Jun 02 21:48:33.198547 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.198518 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.198674 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.198552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qh7\" (UniqueName: \"kubernetes.io/projected/61f08624-38c9-41f3-803d-752a1a00f6db-kube-api-access-85qh7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.198674 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.198639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.299276 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.299239 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.299684 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.299284 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85qh7\" (UniqueName: \"kubernetes.io/projected/61f08624-38c9-41f3-803d-752a1a00f6db-kube-api-access-85qh7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.299684 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.299357 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.299684 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.299639 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.299684 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.299680 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.307510 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.307479 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qh7\" (UniqueName: \"kubernetes.io/projected/61f08624-38c9-41f3-803d-752a1a00f6db-kube-api-access-85qh7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.414323 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.414224 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:33.499945 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.499908 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll"] Jun 02 21:48:33.506263 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.506231 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.510621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.510593 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll"] Jun 02 21:48:33.557561 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.557535 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt"] Jun 02 21:48:33.559705 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:48:33.559678 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f08624_38c9_41f3_803d_752a1a00f6db.slice/crio-da862c808c4d5b53222e83dbf2de8f12dd484b13622418ac316bcb04be7d3a44 WatchSource:0}: Error finding container da862c808c4d5b53222e83dbf2de8f12dd484b13622418ac316bcb04be7d3a44: Status 404 returned error can't find the container with id da862c808c4d5b53222e83dbf2de8f12dd484b13622418ac316bcb04be7d3a44 Jun 02 21:48:33.601341 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.601306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.601474 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.601353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.601520 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.601496 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxvwk\" (UniqueName: \"kubernetes.io/projected/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-kube-api-access-vxvwk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.639499 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.639463 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" event={"ID":"61f08624-38c9-41f3-803d-752a1a00f6db","Type":"ContainerStarted","Data":"53450f02d005310c620e327e82ae2632704595e71b8321ce44493a1193c81e06"} Jun 02 21:48:33.639499 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.639505 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" event={"ID":"61f08624-38c9-41f3-803d-752a1a00f6db","Type":"ContainerStarted","Data":"da862c808c4d5b53222e83dbf2de8f12dd484b13622418ac316bcb04be7d3a44"} Jun 02 21:48:33.641064 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.641034 2565 generic.go:358] "Generic (PLEG): container finished" podID="549474fd-3074-4ec1-9119-9734296b4261" containerID="34213a9b2076aa1f9b36ebe8f93ffdc5c6953657a65c83d45dc9e8290e85607b" exitCode=0 Jun 02 21:48:33.641220 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.641107 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" event={"ID":"549474fd-3074-4ec1-9119-9734296b4261","Type":"ContainerDied","Data":"34213a9b2076aa1f9b36ebe8f93ffdc5c6953657a65c83d45dc9e8290e85607b"} Jun 02 21:48:33.641220 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.641135 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" event={"ID":"549474fd-3074-4ec1-9119-9734296b4261","Type":"ContainerStarted","Data":"74573f9a54bb810262dc3278e6bf7189abcd008381a6af36c90010d3a8e241f1"} Jun 02 21:48:33.642575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.642539 2565 generic.go:358] "Generic (PLEG): container finished" podID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerID="17d283b935db6b52ce0f1cf90b202a52243907f04ec92a23e1817a086575f90a" exitCode=0 Jun 02 21:48:33.642672 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.642591 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" event={"ID":"2db9cf89-3e74-4966-9137-889c3ac3b418","Type":"ContainerDied","Data":"17d283b935db6b52ce0f1cf90b202a52243907f04ec92a23e1817a086575f90a"} Jun 02 21:48:33.642672 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.642614 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" event={"ID":"2db9cf89-3e74-4966-9137-889c3ac3b418","Type":"ContainerStarted","Data":"83ea3769960b0d1c8b12d7610a410a2719005347fd91d90999d78118d9a856d2"} Jun 02 21:48:33.702783 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.702744 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vxvwk\" (UniqueName: \"kubernetes.io/projected/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-kube-api-access-vxvwk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.702980 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.702804 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.702980 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.702822 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.703217 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.703199 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.703276 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.703223 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.710798 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.710773 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxvwk\" (UniqueName: \"kubernetes.io/projected/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-kube-api-access-vxvwk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.829037 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.828987 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:33.960241 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:33.960105 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll"] Jun 02 21:48:33.962344 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:48:33.962314 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33fd4f8_a4d5_4985_8c96_553bb8eea7dd.slice/crio-8214a2620d149dbc843356c0c5520c284ee8708a136a805df46d3083cb2ecd38 WatchSource:0}: Error finding container 8214a2620d149dbc843356c0c5520c284ee8708a136a805df46d3083cb2ecd38: Status 404 returned error can't find the container with id 8214a2620d149dbc843356c0c5520c284ee8708a136a805df46d3083cb2ecd38 Jun 02 21:48:34.648103 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.648069 2565 generic.go:358] "Generic (PLEG): container finished" podID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerID="93a8c92b36cb52c9944b359d6c997aa7b56d5c7a04d8bdc003e21b7c2e0f3942" exitCode=0 Jun 02 21:48:34.648551 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.648185 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" event={"ID":"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd","Type":"ContainerDied","Data":"93a8c92b36cb52c9944b359d6c997aa7b56d5c7a04d8bdc003e21b7c2e0f3942"} Jun 02 21:48:34.648551 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.648230 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" event={"ID":"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd","Type":"ContainerStarted","Data":"8214a2620d149dbc843356c0c5520c284ee8708a136a805df46d3083cb2ecd38"} Jun 02 21:48:34.649752 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.649731 2565 generic.go:358] "Generic (PLEG): container finished" podID="61f08624-38c9-41f3-803d-752a1a00f6db" containerID="53450f02d005310c620e327e82ae2632704595e71b8321ce44493a1193c81e06" exitCode=0 Jun 02 21:48:34.649885 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.649799 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" event={"ID":"61f08624-38c9-41f3-803d-752a1a00f6db","Type":"ContainerDied","Data":"53450f02d005310c620e327e82ae2632704595e71b8321ce44493a1193c81e06"} Jun 02 21:48:34.651643 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.651619 2565 generic.go:358] "Generic (PLEG): container finished" podID="549474fd-3074-4ec1-9119-9734296b4261" containerID="7a7d6fcac9b40066fe7dbf705bc151bb7c9bb12711a23657b0f11cad8bb47126" exitCode=0 Jun 02 21:48:34.651750 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.651673 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" event={"ID":"549474fd-3074-4ec1-9119-9734296b4261","Type":"ContainerDied","Data":"7a7d6fcac9b40066fe7dbf705bc151bb7c9bb12711a23657b0f11cad8bb47126"} Jun 02 21:48:34.653384 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.653371 2565 generic.go:358] "Generic (PLEG): container finished" podID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerID="823c0cecf0375de48b81ba51c3b598bc2db9e52211e2d4c21583aaec67705950" exitCode=0 Jun 02 21:48:34.653442 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:34.653405 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" event={"ID":"2db9cf89-3e74-4966-9137-889c3ac3b418","Type":"ContainerDied","Data":"823c0cecf0375de48b81ba51c3b598bc2db9e52211e2d4c21583aaec67705950"} Jun 02 21:48:35.659062 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.658977 2565 generic.go:358] "Generic (PLEG): container finished" podID="61f08624-38c9-41f3-803d-752a1a00f6db" containerID="118de2dfd1db4a816a2353b4466de411a91a3c9ca1885d77012ce1350f5eaea2" exitCode=0 Jun 02 21:48:35.659473 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.659072 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" event={"ID":"61f08624-38c9-41f3-803d-752a1a00f6db","Type":"ContainerDied","Data":"118de2dfd1db4a816a2353b4466de411a91a3c9ca1885d77012ce1350f5eaea2"} Jun 02 21:48:35.660981 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.660961 2565 generic.go:358] "Generic (PLEG): container finished" podID="549474fd-3074-4ec1-9119-9734296b4261" containerID="395e2443281b003587438ed514893cae313bd7d864b5d87540f6e6d755bd0a74" exitCode=0 Jun 02 21:48:35.661089 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.661034 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" event={"ID":"549474fd-3074-4ec1-9119-9734296b4261","Type":"ContainerDied","Data":"395e2443281b003587438ed514893cae313bd7d864b5d87540f6e6d755bd0a74"} Jun 02 21:48:35.662898 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.662879 2565 generic.go:358] "Generic (PLEG): container finished" podID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerID="b63bfb5ee6ea85c6cfa5524002f8d5205d5dac413c999e985413f9e83637ec07" exitCode=0 Jun 02 21:48:35.662978 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.662955 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" event={"ID":"2db9cf89-3e74-4966-9137-889c3ac3b418","Type":"ContainerDied","Data":"b63bfb5ee6ea85c6cfa5524002f8d5205d5dac413c999e985413f9e83637ec07"} Jun 02 21:48:35.664490 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.664472 2565 generic.go:358] "Generic (PLEG): container finished" podID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerID="55e503613ced367797a40f09c86e2d3cb1c83f973ff0ffd3e7d4e69d080cbcef" exitCode=0 Jun 02 21:48:35.664546 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:35.664517 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" event={"ID":"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd","Type":"ContainerDied","Data":"55e503613ced367797a40f09c86e2d3cb1c83f973ff0ffd3e7d4e69d080cbcef"} Jun 02 21:48:36.670723 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.670687 2565 generic.go:358] "Generic (PLEG): container finished" podID="61f08624-38c9-41f3-803d-752a1a00f6db" containerID="28f33bae9a3f3a01a1516705ffe04fd6783be32c9386b36fdedc0621386467f7" exitCode=0 Jun 02 21:48:36.671128 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.670743 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" event={"ID":"61f08624-38c9-41f3-803d-752a1a00f6db","Type":"ContainerDied","Data":"28f33bae9a3f3a01a1516705ffe04fd6783be32c9386b36fdedc0621386467f7"} Jun 02 21:48:36.672779 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.672756 2565 generic.go:358] "Generic (PLEG): container finished" podID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerID="82d0090fd13a7693bbe397572496c51aa8ebb901b2b889bedbd42386e1c80863" exitCode=0 Jun 02 21:48:36.672891 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.672844 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" event={"ID":"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd","Type":"ContainerDied","Data":"82d0090fd13a7693bbe397572496c51aa8ebb901b2b889bedbd42386e1c80863"} Jun 02 21:48:36.809414 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.809386 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:36.840127 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.840106 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:36.930516 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.930477 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hjb4\" (UniqueName: \"kubernetes.io/projected/2db9cf89-3e74-4966-9137-889c3ac3b418-kube-api-access-7hjb4\") pod \"2db9cf89-3e74-4966-9137-889c3ac3b418\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " Jun 02 21:48:36.930708 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.930551 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9fb5\" (UniqueName: \"kubernetes.io/projected/549474fd-3074-4ec1-9119-9734296b4261-kube-api-access-m9fb5\") pod \"549474fd-3074-4ec1-9119-9734296b4261\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " Jun 02 21:48:36.930708 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.930587 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-util\") pod \"549474fd-3074-4ec1-9119-9734296b4261\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " Jun 02 21:48:36.930708 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.930624 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-util\") pod \"2db9cf89-3e74-4966-9137-889c3ac3b418\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " Jun 02 21:48:36.930708 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.930658 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-bundle\") pod \"2db9cf89-3e74-4966-9137-889c3ac3b418\" (UID: \"2db9cf89-3e74-4966-9137-889c3ac3b418\") " Jun 02 21:48:36.930708 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.930681 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-bundle\") pod \"549474fd-3074-4ec1-9119-9734296b4261\" (UID: \"549474fd-3074-4ec1-9119-9734296b4261\") " Jun 02 21:48:36.931279 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.931222 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-bundle" (OuterVolumeSpecName: "bundle") pod "549474fd-3074-4ec1-9119-9734296b4261" (UID: "549474fd-3074-4ec1-9119-9734296b4261"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:36.931279 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.931231 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-bundle" (OuterVolumeSpecName: "bundle") pod "2db9cf89-3e74-4966-9137-889c3ac3b418" (UID: "2db9cf89-3e74-4966-9137-889c3ac3b418"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:36.933450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.933425 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/549474fd-3074-4ec1-9119-9734296b4261-kube-api-access-m9fb5" (OuterVolumeSpecName: "kube-api-access-m9fb5") pod "549474fd-3074-4ec1-9119-9734296b4261" (UID: "549474fd-3074-4ec1-9119-9734296b4261"). InnerVolumeSpecName "kube-api-access-m9fb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:36.933563 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.933458 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2db9cf89-3e74-4966-9137-889c3ac3b418-kube-api-access-7hjb4" (OuterVolumeSpecName: "kube-api-access-7hjb4") pod "2db9cf89-3e74-4966-9137-889c3ac3b418" (UID: "2db9cf89-3e74-4966-9137-889c3ac3b418"). InnerVolumeSpecName "kube-api-access-7hjb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:36.936505 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.936471 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-util" (OuterVolumeSpecName: "util") pod "549474fd-3074-4ec1-9119-9734296b4261" (UID: "549474fd-3074-4ec1-9119-9734296b4261"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:36.937014 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:36.936993 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-util" (OuterVolumeSpecName: "util") pod "2db9cf89-3e74-4966-9137-889c3ac3b418" (UID: "2db9cf89-3e74-4966-9137-889c3ac3b418"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:37.031972 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.031939 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hjb4\" (UniqueName: \"kubernetes.io/projected/2db9cf89-3e74-4966-9137-889c3ac3b418-kube-api-access-7hjb4\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:37.031972 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.031968 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9fb5\" (UniqueName: \"kubernetes.io/projected/549474fd-3074-4ec1-9119-9734296b4261-kube-api-access-m9fb5\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:37.031972 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.031977 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:37.032231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.031986 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:37.032231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.031994 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2db9cf89-3e74-4966-9137-889c3ac3b418-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:37.032231 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.032002 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/549474fd-3074-4ec1-9119-9734296b4261-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:37.679343 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.679301 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" event={"ID":"549474fd-3074-4ec1-9119-9734296b4261","Type":"ContainerDied","Data":"74573f9a54bb810262dc3278e6bf7189abcd008381a6af36c90010d3a8e241f1"} Jun 02 21:48:37.679343 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.679335 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd" Jun 02 21:48:37.679826 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.679341 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74573f9a54bb810262dc3278e6bf7189abcd008381a6af36c90010d3a8e241f1" Jun 02 21:48:37.681103 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.681082 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" Jun 02 21:48:37.681316 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.681115 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8" event={"ID":"2db9cf89-3e74-4966-9137-889c3ac3b418","Type":"ContainerDied","Data":"83ea3769960b0d1c8b12d7610a410a2719005347fd91d90999d78118d9a856d2"} Jun 02 21:48:37.681316 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.681147 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83ea3769960b0d1c8b12d7610a410a2719005347fd91d90999d78118d9a856d2" Jun 02 21:48:37.822934 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.822905 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:37.853863 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.853840 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:37.939174 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939139 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxvwk\" (UniqueName: \"kubernetes.io/projected/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-kube-api-access-vxvwk\") pod \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " Jun 02 21:48:37.939480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939212 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-util\") pod \"61f08624-38c9-41f3-803d-752a1a00f6db\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " Jun 02 21:48:37.939480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939231 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-bundle\") pod \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " Jun 02 21:48:37.939480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939308 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-bundle\") pod \"61f08624-38c9-41f3-803d-752a1a00f6db\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " Jun 02 21:48:37.939480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939343 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85qh7\" (UniqueName: \"kubernetes.io/projected/61f08624-38c9-41f3-803d-752a1a00f6db-kube-api-access-85qh7\") pod \"61f08624-38c9-41f3-803d-752a1a00f6db\" (UID: \"61f08624-38c9-41f3-803d-752a1a00f6db\") " Jun 02 21:48:37.939480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939375 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-util\") pod \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\" (UID: \"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd\") " Jun 02 21:48:37.939971 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939940 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-bundle" (OuterVolumeSpecName: "bundle") pod "d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" (UID: "d33fd4f8-a4d5-4985-8c96-553bb8eea7dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:37.940045 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.939948 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-bundle" (OuterVolumeSpecName: "bundle") pod "61f08624-38c9-41f3-803d-752a1a00f6db" (UID: "61f08624-38c9-41f3-803d-752a1a00f6db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:37.941983 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.941933 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-kube-api-access-vxvwk" (OuterVolumeSpecName: "kube-api-access-vxvwk") pod "d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" (UID: "d33fd4f8-a4d5-4985-8c96-553bb8eea7dd"). InnerVolumeSpecName "kube-api-access-vxvwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:37.941983 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.941941 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f08624-38c9-41f3-803d-752a1a00f6db-kube-api-access-85qh7" (OuterVolumeSpecName: "kube-api-access-85qh7") pod "61f08624-38c9-41f3-803d-752a1a00f6db" (UID: "61f08624-38c9-41f3-803d-752a1a00f6db"). InnerVolumeSpecName "kube-api-access-85qh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:48:37.944897 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.944876 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-util" (OuterVolumeSpecName: "util") pod "61f08624-38c9-41f3-803d-752a1a00f6db" (UID: "61f08624-38c9-41f3-803d-752a1a00f6db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:37.945258 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:37.945236 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-util" (OuterVolumeSpecName: "util") pod "d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" (UID: "d33fd4f8-a4d5-4985-8c96-553bb8eea7dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:48:38.040900 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.040805 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:38.040900 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.040839 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:38.040900 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.040848 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61f08624-38c9-41f3-803d-752a1a00f6db-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:38.040900 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.040857 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85qh7\" (UniqueName: \"kubernetes.io/projected/61f08624-38c9-41f3-803d-752a1a00f6db-kube-api-access-85qh7\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:38.040900 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.040867 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:38.040900 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.040876 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxvwk\" (UniqueName: \"kubernetes.io/projected/d33fd4f8-a4d5-4985-8c96-553bb8eea7dd-kube-api-access-vxvwk\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:48:38.686364 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.686335 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" Jun 02 21:48:38.686364 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.686349 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll" event={"ID":"d33fd4f8-a4d5-4985-8c96-553bb8eea7dd","Type":"ContainerDied","Data":"8214a2620d149dbc843356c0c5520c284ee8708a136a805df46d3083cb2ecd38"} Jun 02 21:48:38.686910 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.686387 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8214a2620d149dbc843356c0c5520c284ee8708a136a805df46d3083cb2ecd38" Jun 02 21:48:38.688060 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.688034 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" event={"ID":"61f08624-38c9-41f3-803d-752a1a00f6db","Type":"ContainerDied","Data":"da862c808c4d5b53222e83dbf2de8f12dd484b13622418ac316bcb04be7d3a44"} Jun 02 21:48:38.688060 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.688060 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da862c808c4d5b53222e83dbf2de8f12dd484b13622418ac316bcb04be7d3a44" Jun 02 21:48:38.688234 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:38.688081 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt" Jun 02 21:48:55.824608 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824574 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9m4zg"] Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824943 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824954 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824965 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="pull" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824970 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="pull" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824976 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="extract" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824984 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="extract" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.824994 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825000 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825008 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825013 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825019 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="extract" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825024 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="extract" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825030 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="extract" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825035 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="extract" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825041 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825046 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="util" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825051 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="pull" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825056 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="pull" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825066 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="pull" Jun 02 21:48:55.825067 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825071 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="pull" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825081 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="extract" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825086 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="extract" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825092 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="pull" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825096 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="pull" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825148 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="549474fd-3074-4ec1-9119-9734296b4261" containerName="extract" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825172 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="2db9cf89-3e74-4966-9137-889c3ac3b418" containerName="extract" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825179 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d33fd4f8-a4d5-4985-8c96-553bb8eea7dd" containerName="extract" Jun 02 21:48:55.825710 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.825187 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="61f08624-38c9-41f3-803d-752a1a00f6db" containerName="extract" Jun 02 21:48:55.833188 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.833154 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:48:55.835869 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.835843 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-k9mx2\"" Jun 02 21:48:55.836296 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.835852 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 21:48:55.836296 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.835899 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 21:48:55.837990 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.837966 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9m4zg"] Jun 02 21:48:55.898599 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.898564 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmvw\" (UniqueName: \"kubernetes.io/projected/4340764b-9367-4d7a-9109-dd01f2550c33-kube-api-access-twmvw\") pod \"authorino-operator-657f44b778-9m4zg\" (UID: \"4340764b-9367-4d7a-9109-dd01f2550c33\") " pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:48:55.999242 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:55.999198 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twmvw\" (UniqueName: \"kubernetes.io/projected/4340764b-9367-4d7a-9109-dd01f2550c33-kube-api-access-twmvw\") pod \"authorino-operator-657f44b778-9m4zg\" (UID: \"4340764b-9367-4d7a-9109-dd01f2550c33\") " pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:48:56.007409 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:56.007384 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmvw\" (UniqueName: \"kubernetes.io/projected/4340764b-9367-4d7a-9109-dd01f2550c33-kube-api-access-twmvw\") pod \"authorino-operator-657f44b778-9m4zg\" (UID: \"4340764b-9367-4d7a-9109-dd01f2550c33\") " pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:48:56.145026 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:56.144933 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:48:56.277089 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:56.277060 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-9m4zg"] Jun 02 21:48:56.279062 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:48:56.279038 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4340764b_9367_4d7a_9109_dd01f2550c33.slice/crio-3bcac2e97357accd2579fba9cea50d19fd1f1e4bcc35c983d2b6f77cea565846 WatchSource:0}: Error finding container 3bcac2e97357accd2579fba9cea50d19fd1f1e4bcc35c983d2b6f77cea565846: Status 404 returned error can't find the container with id 3bcac2e97357accd2579fba9cea50d19fd1f1e4bcc35c983d2b6f77cea565846 Jun 02 21:48:56.758156 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:56.758123 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" event={"ID":"4340764b-9367-4d7a-9109-dd01f2550c33","Type":"ContainerStarted","Data":"3bcac2e97357accd2579fba9cea50d19fd1f1e4bcc35c983d2b6f77cea565846"} Jun 02 21:48:58.768483 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:58.768442 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" event={"ID":"4340764b-9367-4d7a-9109-dd01f2550c33","Type":"ContainerStarted","Data":"81407513b7683eae415e28a060644247be2b36eb0984e55004a0e66a27bf959a"} Jun 02 21:48:58.768898 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:58.768561 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:48:58.805846 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:48:58.805794 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" podStartSLOduration=1.47246689 podStartE2EDuration="3.805779343s" podCreationTimestamp="2026-06-02 21:48:55 +0000 UTC" firstStartedPulling="2026-06-02 21:48:56.281275493 +0000 UTC m=+455.680006325" lastFinishedPulling="2026-06-02 21:48:58.614587938 +0000 UTC m=+458.013318778" observedRunningTime="2026-06-02 21:48:58.803512264 +0000 UTC m=+458.202243120" watchObservedRunningTime="2026-06-02 21:48:58.805779343 +0000 UTC m=+458.204510198" Jun 02 21:49:09.776116 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:09.776083 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-9m4zg" Jun 02 21:49:30.913051 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.913020 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d7d66d785-4lwnk"] Jun 02 21:49:30.922385 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.922343 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:30.925098 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.924815 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 21:49:30.925377 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.925207 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4jddz\"" Jun 02 21:49:30.925654 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.925628 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 21:49:30.926864 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.926829 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 21:49:30.927398 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.927372 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 21:49:30.929319 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.929255 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 21:49:30.929794 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.929763 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 21:49:30.930382 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.930362 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 21:49:30.932587 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.932354 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7d66d785-4lwnk"] Jun 02 21:49:30.938740 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:30.938717 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 21:49:31.025625 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpfmf\" (UniqueName: \"kubernetes.io/projected/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-kube-api-access-wpfmf\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.025807 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-trusted-ca-bundle\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.025807 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-service-ca\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.025907 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-oauth-config\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.025907 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-serving-cert\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.025992 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025936 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-config\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.025992 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.025955 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-oauth-serving-cert\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127364 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127312 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-config\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127364 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127361 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-oauth-serving-cert\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127431 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpfmf\" (UniqueName: \"kubernetes.io/projected/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-kube-api-access-wpfmf\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127463 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-trusted-ca-bundle\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127520 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-service-ca\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127547 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-oauth-config\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.127621 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.127577 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-serving-cert\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.128246 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.128210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-config\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.128368 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.128246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-service-ca\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.128368 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.128220 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-oauth-serving-cert\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.128368 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.128352 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-trusted-ca-bundle\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.130092 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.130069 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-serving-cert\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.130092 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.130080 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-console-oauth-config\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.136866 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.136842 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpfmf\" (UniqueName: \"kubernetes.io/projected/2384ad7e-7d7e-4e77-a3ca-f658bd4151bc-kube-api-access-wpfmf\") pod \"console-6d7d66d785-4lwnk\" (UID: \"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc\") " pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.236229 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.236090 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:31.377097 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.377063 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d7d66d785-4lwnk"] Jun 02 21:49:31.379081 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:49:31.379021 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2384ad7e_7d7e_4e77_a3ca_f658bd4151bc.slice/crio-958b99ba16aea32b0cd2c23bae7c4c976731e5796966887b00d497c60cad524c WatchSource:0}: Error finding container 958b99ba16aea32b0cd2c23bae7c4c976731e5796966887b00d497c60cad524c: Status 404 returned error can't find the container with id 958b99ba16aea32b0cd2c23bae7c4c976731e5796966887b00d497c60cad524c Jun 02 21:49:31.899118 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.899078 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7d66d785-4lwnk" event={"ID":"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc","Type":"ContainerStarted","Data":"4160e563c534d1e49c06e70155f7053f9b441410fc64fff18e481a995dc2b8f1"} Jun 02 21:49:31.899322 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.899124 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d7d66d785-4lwnk" event={"ID":"2384ad7e-7d7e-4e77-a3ca-f658bd4151bc","Type":"ContainerStarted","Data":"958b99ba16aea32b0cd2c23bae7c4c976731e5796966887b00d497c60cad524c"} Jun 02 21:49:31.916927 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:31.916872 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d7d66d785-4lwnk" podStartSLOduration=1.916856742 podStartE2EDuration="1.916856742s" podCreationTimestamp="2026-06-02 21:49:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 21:49:31.915301958 +0000 UTC m=+491.314032835" watchObservedRunningTime="2026-06-02 21:49:31.916856742 +0000 UTC m=+491.315587597" Jun 02 21:49:41.236622 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:41.236558 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:41.236622 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:41.236624 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:41.241372 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:41.241348 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:49:41.949617 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:49:41.949578 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d7d66d785-4lwnk" Jun 02 21:50:26.980450 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:26.980358 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48"] Jun 02 21:50:26.983531 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:26.983509 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:26.985966 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:26.985947 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 21:50:26.986697 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:26.986681 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 21:50:26.986772 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:26.986706 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6fch\"" Jun 02 21:50:26.992362 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:26.992341 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48"] Jun 02 21:50:27.012026 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.012002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkfqq\" (UniqueName: \"kubernetes.io/projected/d3047715-3bc8-4a12-a080-d0e8f69a8daf-kube-api-access-hkfqq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.012134 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.012061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.012134 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.012115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.112531 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.112500 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.112705 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.112553 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hkfqq\" (UniqueName: \"kubernetes.io/projected/d3047715-3bc8-4a12-a080-d0e8f69a8daf-kube-api-access-hkfqq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.112705 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.112602 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.113030 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.113005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.113070 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.113023 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.122132 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.122108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkfqq\" (UniqueName: \"kubernetes.io/projected/d3047715-3bc8-4a12-a080-d0e8f69a8daf-kube-api-access-hkfqq\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.293654 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.293619 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:27.424814 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:27.424787 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48"] Jun 02 21:50:27.426548 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:50:27.426522 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3047715_3bc8_4a12_a080_d0e8f69a8daf.slice/crio-6b72d8af5745034134c0975aa4bbd03fbaf3781480669fb363c5bef91ad44c53 WatchSource:0}: Error finding container 6b72d8af5745034134c0975aa4bbd03fbaf3781480669fb363c5bef91ad44c53: Status 404 returned error can't find the container with id 6b72d8af5745034134c0975aa4bbd03fbaf3781480669fb363c5bef91ad44c53 Jun 02 21:50:28.130877 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:28.130848 2565 generic.go:358] "Generic (PLEG): container finished" podID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerID="7a9d54585857c3d2c05b188eb1647a690fa372f30256a01e0b0461509dd241cb" exitCode=0 Jun 02 21:50:28.131198 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:28.130895 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" event={"ID":"d3047715-3bc8-4a12-a080-d0e8f69a8daf","Type":"ContainerDied","Data":"7a9d54585857c3d2c05b188eb1647a690fa372f30256a01e0b0461509dd241cb"} Jun 02 21:50:28.131198 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:28.130915 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" event={"ID":"d3047715-3bc8-4a12-a080-d0e8f69a8daf","Type":"ContainerStarted","Data":"6b72d8af5745034134c0975aa4bbd03fbaf3781480669fb363c5bef91ad44c53"} Jun 02 21:50:29.135657 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:29.135577 2565 generic.go:358] "Generic (PLEG): container finished" podID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerID="6a9d9f61caf5b57534ae9c1375d9e0933ff63713fb9ba353b86f360b6d559309" exitCode=0 Jun 02 21:50:29.135657 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:29.135623 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" event={"ID":"d3047715-3bc8-4a12-a080-d0e8f69a8daf","Type":"ContainerDied","Data":"6a9d9f61caf5b57534ae9c1375d9e0933ff63713fb9ba353b86f360b6d559309"} Jun 02 21:50:30.141473 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:30.141438 2565 generic.go:358] "Generic (PLEG): container finished" podID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerID="4af4d6f48c09609fbdfcc52108dd26d11872650d5e00bb55924e04a393296438" exitCode=0 Jun 02 21:50:30.141854 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:30.141525 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" event={"ID":"d3047715-3bc8-4a12-a080-d0e8f69a8daf","Type":"ContainerDied","Data":"4af4d6f48c09609fbdfcc52108dd26d11872650d5e00bb55924e04a393296438"} Jun 02 21:50:31.282345 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.282321 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:31.347792 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.347755 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-bundle\") pod \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " Jun 02 21:50:31.347935 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.347878 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkfqq\" (UniqueName: \"kubernetes.io/projected/d3047715-3bc8-4a12-a080-d0e8f69a8daf-kube-api-access-hkfqq\") pod \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " Jun 02 21:50:31.347935 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.347908 2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-util\") pod \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\" (UID: \"d3047715-3bc8-4a12-a080-d0e8f69a8daf\") " Jun 02 21:50:31.348369 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.348348 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-bundle" (OuterVolumeSpecName: "bundle") pod "d3047715-3bc8-4a12-a080-d0e8f69a8daf" (UID: "d3047715-3bc8-4a12-a080-d0e8f69a8daf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:50:31.349944 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.349915 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3047715-3bc8-4a12-a080-d0e8f69a8daf-kube-api-access-hkfqq" (OuterVolumeSpecName: "kube-api-access-hkfqq") pod "d3047715-3bc8-4a12-a080-d0e8f69a8daf" (UID: "d3047715-3bc8-4a12-a080-d0e8f69a8daf"). InnerVolumeSpecName "kube-api-access-hkfqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 21:50:31.353190 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.353151 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-util" (OuterVolumeSpecName: "util") pod "d3047715-3bc8-4a12-a080-d0e8f69a8daf" (UID: "d3047715-3bc8-4a12-a080-d0e8f69a8daf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 21:50:31.448732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.448655 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkfqq\" (UniqueName: \"kubernetes.io/projected/d3047715-3bc8-4a12-a080-d0e8f69a8daf-kube-api-access-hkfqq\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:50:31.448732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.448680 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:50:31.448732 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:31.448690 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3047715-3bc8-4a12-a080-d0e8f69a8daf-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 21:50:32.157731 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:32.155736 2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" Jun 02 21:50:32.157731 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:32.155735 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a7084r48" event={"ID":"d3047715-3bc8-4a12-a080-d0e8f69a8daf","Type":"ContainerDied","Data":"6b72d8af5745034134c0975aa4bbd03fbaf3781480669fb363c5bef91ad44c53"} Jun 02 21:50:32.157731 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:32.155782 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b72d8af5745034134c0975aa4bbd03fbaf3781480669fb363c5bef91ad44c53" Jun 02 21:50:32.199695 ip-10-0-141-177 kubenswrapper[2565]: E0602 21:50:32.199666 2565 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3047715_3bc8_4a12_a080_d0e8f69a8daf.slice\": RecentStats: unable to find data in memory cache]" Jun 02 21:50:34.423186 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423129 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-9snhd"] Jun 02 21:50:34.423575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423517 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="pull" Jun 02 21:50:34.423575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423529 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="pull" Jun 02 21:50:34.423575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423546 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="util" Jun 02 21:50:34.423575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423551 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="util" Jun 02 21:50:34.423575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423559 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="extract" Jun 02 21:50:34.423575 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423564 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="extract" Jun 02 21:50:34.423768 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.423628 2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d3047715-3bc8-4a12-a080-d0e8f69a8daf" containerName="extract" Jun 02 21:50:34.425884 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.425869 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" Jun 02 21:50:34.428254 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.428232 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 21:50:34.428254 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.428241 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 21:50:34.428480 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.428460 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-wqxvm\"" Jun 02 21:50:34.435581 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.435554 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-9snhd"] Jun 02 21:50:34.475054 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.475023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qztg9\" (UniqueName: \"kubernetes.io/projected/e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca-kube-api-access-qztg9\") pod \"keycloak-operator-7864d68cbd-9snhd\" (UID: \"e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca\") " pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" Jun 02 21:50:34.575672 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.575634 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qztg9\" (UniqueName: \"kubernetes.io/projected/e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca-kube-api-access-qztg9\") pod \"keycloak-operator-7864d68cbd-9snhd\" (UID: \"e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca\") " pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" Jun 02 21:50:34.584749 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.584718 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qztg9\" (UniqueName: \"kubernetes.io/projected/e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca-kube-api-access-qztg9\") pod \"keycloak-operator-7864d68cbd-9snhd\" (UID: \"e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca\") " pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" Jun 02 21:50:34.737452 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.737357 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" Jun 02 21:50:34.868784 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:34.868754 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-9snhd"] Jun 02 21:50:34.869891 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:50:34.869866 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9cc4203_bd01_4c3f_8200_d2bfe6fa88ca.slice/crio-eeabf00287b2100e0a9ff6e4d6f47cf0ea5dee3bc4c9a59d79e56ce14604f045 WatchSource:0}: Error finding container eeabf00287b2100e0a9ff6e4d6f47cf0ea5dee3bc4c9a59d79e56ce14604f045: Status 404 returned error can't find the container with id eeabf00287b2100e0a9ff6e4d6f47cf0ea5dee3bc4c9a59d79e56ce14604f045 Jun 02 21:50:35.167882 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:35.167839 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" event={"ID":"e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca","Type":"ContainerStarted","Data":"eeabf00287b2100e0a9ff6e4d6f47cf0ea5dee3bc4c9a59d79e56ce14604f045"} Jun 02 21:50:40.194388 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:40.194350 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" event={"ID":"e9cc4203-bd01-4c3f-8200-d2bfe6fa88ca","Type":"ContainerStarted","Data":"a68fe05e084268c81834832d92f8143ba18c091540bc3e9cb7e4e0eed1a78683"} Jun 02 21:50:40.209305 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:50:40.209249 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-9snhd" podStartSLOduration=1.3884722219999999 podStartE2EDuration="6.209234583s" podCreationTimestamp="2026-06-02 21:50:34 +0000 UTC" firstStartedPulling="2026-06-02 21:50:34.871275723 +0000 UTC m=+554.270006556" lastFinishedPulling="2026-06-02 21:50:39.692038084 +0000 UTC m=+559.090768917" observedRunningTime="2026-06-02 21:50:40.208348465 +0000 UTC m=+559.607079319" watchObservedRunningTime="2026-06-02 21:50:40.209234583 +0000 UTC m=+559.607965437" Jun 02 21:51:21.067389 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:51:21.067362 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:51:21.069312 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:51:21.069287 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:52:52.076307 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.076267 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg"] Jun 02 21:52:52.079448 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.079424 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.082418 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.082398 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 21:52:52.082540 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.082422 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pmq97\"" Jun 02 21:52:52.082540 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.082400 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 21:52:52.082540 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.082490 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 21:52:52.088548 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.088526 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg"] Jun 02 21:52:52.106213 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.106152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.106348 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.106225 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ph9\" (UniqueName: \"kubernetes.io/projected/2eb77631-8e0f-4130-a260-2c16ee86ed77-kube-api-access-r4ph9\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.106348 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.106275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.106348 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.106320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb77631-8e0f-4130-a260-2c16ee86ed77-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.106465 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.106352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.106465 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.106386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.206993 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.206945 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207220 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207037 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207220 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207086 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207220 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207120 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ph9\" (UniqueName: \"kubernetes.io/projected/2eb77631-8e0f-4130-a260-2c16ee86ed77-kube-api-access-r4ph9\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207433 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207250 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207433 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207300 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb77631-8e0f-4130-a260-2c16ee86ed77-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207605 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207444 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207675 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207616 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.207880 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.207857 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.209841 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.209814 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2eb77631-8e0f-4130-a260-2c16ee86ed77-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.210107 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.210089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2eb77631-8e0f-4130-a260-2c16ee86ed77-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.214533 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.214503 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ph9\" (UniqueName: \"kubernetes.io/projected/2eb77631-8e0f-4130-a260-2c16ee86ed77-kube-api-access-r4ph9\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg\" (UID: \"2eb77631-8e0f-4130-a260-2c16ee86ed77\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.391284 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.391188 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:52:52.526287 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.526256 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg"] Jun 02 21:52:52.528035 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:52:52.527991 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eb77631_8e0f_4130_a260_2c16ee86ed77.slice/crio-9b85a2b46cd2fc6f73d93d93b3f5b18c10732685b6f1fcf3ea17e2a35c87bb8c WatchSource:0}: Error finding container 9b85a2b46cd2fc6f73d93d93b3f5b18c10732685b6f1fcf3ea17e2a35c87bb8c: Status 404 returned error can't find the container with id 9b85a2b46cd2fc6f73d93d93b3f5b18c10732685b6f1fcf3ea17e2a35c87bb8c Jun 02 21:52:52.530232 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.530214 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 21:52:52.738562 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:52.738476 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" event={"ID":"2eb77631-8e0f-4130-a260-2c16ee86ed77","Type":"ContainerStarted","Data":"9b85a2b46cd2fc6f73d93d93b3f5b18c10732685b6f1fcf3ea17e2a35c87bb8c"} Jun 02 21:52:55.754944 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:55.754908 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" event={"ID":"2eb77631-8e0f-4130-a260-2c16ee86ed77","Type":"ContainerStarted","Data":"c96dd938d8fcf049a479db5f7ebc01c2a2f7f921084936d10a6d5c4c68044a0e"} Jun 02 21:52:57.764728 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:57.764694 2565 generic.go:358] "Generic (PLEG): container finished" podID="2eb77631-8e0f-4130-a260-2c16ee86ed77" containerID="c96dd938d8fcf049a479db5f7ebc01c2a2f7f921084936d10a6d5c4c68044a0e" exitCode=0 Jun 02 21:52:57.765248 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:57.764783 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" event={"ID":"2eb77631-8e0f-4130-a260-2c16ee86ed77","Type":"ContainerDied","Data":"c96dd938d8fcf049a479db5f7ebc01c2a2f7f921084936d10a6d5c4c68044a0e"} Jun 02 21:52:59.775837 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:59.775802 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" event={"ID":"2eb77631-8e0f-4130-a260-2c16ee86ed77","Type":"ContainerStarted","Data":"272e093ff118d86e1d4ddfffce42c3f9c50ada7596d60208c39ccdccc9e2129a"} Jun 02 21:52:59.798810 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:52:59.798760 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" podStartSLOduration=1.5323 podStartE2EDuration="7.798747732s" podCreationTimestamp="2026-06-02 21:52:52 +0000 UTC" firstStartedPulling="2026-06-02 21:52:52.530354497 +0000 UTC m=+691.929085330" lastFinishedPulling="2026-06-02 21:52:58.796802225 +0000 UTC m=+698.195533062" observedRunningTime="2026-06-02 21:52:59.79572601 +0000 UTC m=+699.194456856" watchObservedRunningTime="2026-06-02 21:52:59.798747732 +0000 UTC m=+699.197478587" Jun 02 21:53:02.392369 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:02.392265 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:53:02.392775 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:02.392405 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:53:02.405005 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:02.404965 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:53:02.799327 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:02.799298 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg" Jun 02 21:53:27.503643 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.503609 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb"] Jun 02 21:53:27.506943 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.506924 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.509502 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.509479 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 02 21:53:27.520524 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.520500 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb"] Jun 02 21:53:27.636259 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.636216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgcvq\" (UniqueName: \"kubernetes.io/projected/a7fa948b-8a88-4999-acee-a50a087b0ab6-kube-api-access-dgcvq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.636422 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.636277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.636422 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.636377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.636496 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.636436 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.636496 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.636479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fa948b-8a88-4999-acee-a50a087b0ab6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.636572 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.636545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.737557 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.737512 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.737745 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.737574 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dgcvq\" (UniqueName: \"kubernetes.io/projected/a7fa948b-8a88-4999-acee-a50a087b0ab6-kube-api-access-dgcvq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.737745 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.737626 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.737745 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.737659 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.737745 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.737698 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.737745 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.737731 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fa948b-8a88-4999-acee-a50a087b0ab6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.738070 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.738039 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.738138 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.738048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.738138 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.738101 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.739976 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.739955 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7fa948b-8a88-4999-acee-a50a087b0ab6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.740154 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.740136 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7fa948b-8a88-4999-acee-a50a087b0ab6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.747096 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.747073 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgcvq\" (UniqueName: \"kubernetes.io/projected/a7fa948b-8a88-4999-acee-a50a087b0ab6-kube-api-access-dgcvq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb\" (UID: \"a7fa948b-8a88-4999-acee-a50a087b0ab6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.818841 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.818769 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:27.951655 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:27.951625 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb"] Jun 02 21:53:27.953498 ip-10-0-141-177 kubenswrapper[2565]: W0602 21:53:27.953473 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fa948b_8a88_4999_acee_a50a087b0ab6.slice/crio-7658c565f76533a5394fed939f5540a81f6eaa28b2ed5298cf487bf940e60d58 WatchSource:0}: Error finding container 7658c565f76533a5394fed939f5540a81f6eaa28b2ed5298cf487bf940e60d58: Status 404 returned error can't find the container with id 7658c565f76533a5394fed939f5540a81f6eaa28b2ed5298cf487bf940e60d58 Jun 02 21:53:28.895079 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:28.895039 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" event={"ID":"a7fa948b-8a88-4999-acee-a50a087b0ab6","Type":"ContainerStarted","Data":"a2d8e040a4965b31c71dbd76ea391956d3d11f6833a4bf3549ba4342689273ee"} Jun 02 21:53:28.895079 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:28.895083 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" event={"ID":"a7fa948b-8a88-4999-acee-a50a087b0ab6","Type":"ContainerStarted","Data":"7658c565f76533a5394fed939f5540a81f6eaa28b2ed5298cf487bf940e60d58"} Jun 02 21:53:37.938140 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:37.938106 2565 generic.go:358] "Generic (PLEG): container finished" podID="a7fa948b-8a88-4999-acee-a50a087b0ab6" containerID="a2d8e040a4965b31c71dbd76ea391956d3d11f6833a4bf3549ba4342689273ee" exitCode=0 Jun 02 21:53:37.938532 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:37.938195 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" event={"ID":"a7fa948b-8a88-4999-acee-a50a087b0ab6","Type":"ContainerDied","Data":"a2d8e040a4965b31c71dbd76ea391956d3d11f6833a4bf3549ba4342689273ee"} Jun 02 21:53:38.944814 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:38.944780 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" event={"ID":"a7fa948b-8a88-4999-acee-a50a087b0ab6","Type":"ContainerStarted","Data":"d372c9cef72a7c45ff4fd0e8a61f622ae79c60b8d96010087bb6b63167d18320"} Jun 02 21:53:38.970591 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:38.970533 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" podStartSLOduration=11.780313117 podStartE2EDuration="11.970520121s" podCreationTimestamp="2026-06-02 21:53:27 +0000 UTC" firstStartedPulling="2026-06-02 21:53:37.938846357 +0000 UTC m=+737.337577191" lastFinishedPulling="2026-06-02 21:53:38.129053359 +0000 UTC m=+737.527784195" observedRunningTime="2026-06-02 21:53:38.969413074 +0000 UTC m=+738.368144124" watchObservedRunningTime="2026-06-02 21:53:38.970520121 +0000 UTC m=+738.369250975" Jun 02 21:53:47.819799 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:47.819759 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:47.819799 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:47.819809 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:47.832449 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:47.832422 2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:53:47.998532 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:53:47.998503 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb" Jun 02 21:56:21.105105 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:56:21.105022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 21:56:21.107506 ip-10-0-141-177 kubenswrapper[2565]: I0602 21:56:21.107473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:01:21.143570 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:01:21.143536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:01:21.147979 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:01:21.147950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:06:21.201054 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:06:21.201024 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:06:21.205729 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:06:21.205707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:11:21.234559 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:11:21.234532 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:11:21.240767 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:11:21.240743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:16:21.268535 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:16:21.268505 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:16:21.280110 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:16:21.280087 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:19:10.095936 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:10.095904 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-659c675bb5-fm96x_551545a7-e23a-4ca0-9e3c-ad3b831f8f3b/nginx/0.log" Jun 02 22:19:10.346639 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:10.346565 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-tsr85_a9a641bd-4bc5-4de8-8b51-f335e1aaf84f/manager/0.log" Jun 02 22:19:10.462955 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:10.462928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-sj2mw_a7c84f4d-b760-47b8-9070-773409565970/manager/0.log" Jun 02 22:19:11.037483 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:11.037446 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-nkfdh_df323c12-a5e3-45c0-9e36-1516f13275b3/server/0.log" Jun 02 22:19:11.152000 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:11.151967 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-84z9b_2e98be8c-3235-4184-a64a-fe1db2b7d954/manager/0.log" Jun 02 22:19:11.529017 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:11.528992 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-dnqzm_9de808af-c628-4f2f-9a1d-35425ffc0bb3/copy-manifests/0.log" Jun 02 22:19:11.535753 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:11.535724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-dnqzm_9de808af-c628-4f2f-9a1d-35425ffc0bb3/manager/0.log" Jun 02 22:19:12.442039 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.442008 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd_549474fd-3074-4ec1-9119-9734296b4261/util/0.log" Jun 02 22:19:12.447976 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.447954 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd_549474fd-3074-4ec1-9119-9734296b4261/pull/0.log" Jun 02 22:19:12.453558 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.453543 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd_549474fd-3074-4ec1-9119-9734296b4261/extract/0.log" Jun 02 22:19:12.571387 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.571355 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8_2db9cf89-3e74-4966-9137-889c3ac3b418/util/0.log" Jun 02 22:19:12.577666 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.577646 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8_2db9cf89-3e74-4966-9137-889c3ac3b418/pull/0.log" Jun 02 22:19:12.583860 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.583843 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8_2db9cf89-3e74-4966-9137-889c3ac3b418/extract/0.log" Jun 02 22:19:12.703544 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.703476 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt_61f08624-38c9-41f3-803d-752a1a00f6db/util/0.log" Jun 02 22:19:12.710812 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.710780 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt_61f08624-38c9-41f3-803d-752a1a00f6db/pull/0.log" Jun 02 22:19:12.720334 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.720310 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt_61f08624-38c9-41f3-803d-752a1a00f6db/extract/0.log" Jun 02 22:19:12.844583 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.844551 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll_d33fd4f8-a4d5-4985-8c96-553bb8eea7dd/util/0.log" Jun 02 22:19:12.850143 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.850124 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll_d33fd4f8-a4d5-4985-8c96-553bb8eea7dd/pull/0.log" Jun 02 22:19:12.855839 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:12.855817 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll_d33fd4f8-a4d5-4985-8c96-553bb8eea7dd/extract/0.log" Jun 02 22:19:13.099925 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:13.099896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-9m4zg_4340764b-9367-4d7a-9109-dd01f2550c33/manager/0.log" Jun 02 22:19:14.308924 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:14.308895 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-q5ft9_02fc461e-037b-4a99-829f-90a20b68c25c/discovery/0.log" Jun 02 22:19:14.550933 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:14.550905 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b495b9df5-qrtbf_9f95740d-c183-46ff-b932-34497b278cba/kube-auth-proxy/0.log" Jun 02 22:19:14.901560 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:14.901532 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84c4d7b6d5-nxmpw_29ed9a93-37a0-4e48-bc78-f3f706cb9ade/router/0.log" Jun 02 22:19:15.280031 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:15.280000 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg_2eb77631-8e0f-4130-a260-2c16ee86ed77/storage-initializer/0.log" Jun 02 22:19:15.287575 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:15.287554 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-n74gg_2eb77631-8e0f-4130-a260-2c16ee86ed77/main/0.log" Jun 02 22:19:15.668595 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:15.668510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb_a7fa948b-8a88-4999-acee-a50a087b0ab6/storage-initializer/0.log" Jun 02 22:19:15.687498 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:15.687473 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9wzzbb_a7fa948b-8a88-4999-acee-a50a087b0ab6/main/0.log" Jun 02 22:19:23.691965 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:23.691934 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s8lgz_04f83630-51e2-45e2-bc2b-e41ee082f0df/global-pull-secret-syncer/0.log" Jun 02 22:19:23.773926 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:23.773898 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6zsmw_34339983-2b0c-4d12-98e3-adee17a94e20/konnectivity-agent/0.log" Jun 02 22:19:23.861866 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:23.861835 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-177.ec2.internal_00ab6e9e70b3869b45a8dbd4d89dd58d/haproxy/0.log" Jun 02 22:19:27.918327 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:27.918298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd_549474fd-3074-4ec1-9119-9734296b4261/extract/0.log" Jun 02 22:19:27.949402 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:27.949375 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd_549474fd-3074-4ec1-9119-9734296b4261/util/0.log" Jun 02 22:19:27.971782 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:27.971753 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mqjqd_549474fd-3074-4ec1-9119-9734296b4261/pull/0.log" Jun 02 22:19:27.996699 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:27.996673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8_2db9cf89-3e74-4966-9137-889c3ac3b418/extract/0.log" Jun 02 22:19:28.026971 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.026945 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8_2db9cf89-3e74-4966-9137-889c3ac3b418/util/0.log" Jun 02 22:19:28.061844 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.061821 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0zkhm8_2db9cf89-3e74-4966-9137-889c3ac3b418/pull/0.log" Jun 02 22:19:28.086192 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.086173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt_61f08624-38c9-41f3-803d-752a1a00f6db/extract/0.log" Jun 02 22:19:28.106370 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.106345 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt_61f08624-38c9-41f3-803d-752a1a00f6db/util/0.log" Jun 02 22:19:28.126370 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.126348 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed736wdvt_61f08624-38c9-41f3-803d-752a1a00f6db/pull/0.log" Jun 02 22:19:28.155702 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.155680 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll_d33fd4f8-a4d5-4985-8c96-553bb8eea7dd/extract/0.log" Jun 02 22:19:28.174777 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.174725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll_d33fd4f8-a4d5-4985-8c96-553bb8eea7dd/util/0.log" Jun 02 22:19:28.193576 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.193549 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zqjll_d33fd4f8-a4d5-4985-8c96-553bb8eea7dd/pull/0.log" Jun 02 22:19:28.419889 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:28.419859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-9m4zg_4340764b-9367-4d7a-9109-dd01f2550c33/manager/0.log" Jun 02 22:19:30.156854 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.156827 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-t4rm8_bb905274-b12f-4db1-b055-653cef8f4162/cluster-monitoring-operator/0.log" Jun 02 22:19:30.180062 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.180028 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tcnm2_e8678870-39cf-4a3b-8c6e-5faa56ccead1/kube-state-metrics/0.log" Jun 02 22:19:30.198986 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.198958 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tcnm2_e8678870-39cf-4a3b-8c6e-5faa56ccead1/kube-rbac-proxy-main/0.log" Jun 02 22:19:30.217496 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.217470 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tcnm2_e8678870-39cf-4a3b-8c6e-5faa56ccead1/kube-rbac-proxy-self/0.log" Jun 02 22:19:30.277026 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.277002 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-7c6zl_438e1b74-11c2-479d-b101-0d1b66852105/monitoring-plugin/0.log" Jun 02 22:19:30.462787 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.462714 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzcjp_c4592562-c746-46ee-9abd-37881388d2f7/node-exporter/0.log" Jun 02 22:19:30.487567 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.487543 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzcjp_c4592562-c746-46ee-9abd-37881388d2f7/kube-rbac-proxy/0.log" Jun 02 22:19:30.510374 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.510348 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zzcjp_c4592562-c746-46ee-9abd-37881388d2f7/init-textfile/0.log" Jun 02 22:19:30.819402 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.819376 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-b7t6c_fa61a124-dcc4-416f-ad6d-a51c4b5ba225/prometheus-operator/0.log" Jun 02 22:19:30.844543 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.844523 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-b7t6c_fa61a124-dcc4-416f-ad6d-a51c4b5ba225/kube-rbac-proxy/0.log" Jun 02 22:19:30.908235 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.908215 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-657f7c8cbf-55xp5_fee33acf-ec72-4270-b56a-93d9d177744d/telemeter-client/0.log" Jun 02 22:19:30.928011 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.927969 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-657f7c8cbf-55xp5_fee33acf-ec72-4270-b56a-93d9d177744d/reload/0.log" Jun 02 22:19:30.950407 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:30.950383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-657f7c8cbf-55xp5_fee33acf-ec72-4270-b56a-93d9d177744d/kube-rbac-proxy/0.log" Jun 02 22:19:32.233911 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:32.233872 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-wkgfz_3866eb94-6864-40c4-a117-6007118e0685/networking-console-plugin/0.log" Jun 02 22:19:32.829593 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:32.829566 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/2.log" Jun 02 22:19:32.833434 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:32.833403 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-f5jfk_3f7c38e8-5dfc-4627-bb00-4b318c4a936c/console-operator/3.log" Jun 02 22:19:33.303537 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:33.303486 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d7d66d785-4lwnk_2384ad7e-7d7e-4e77-a3ca-f658bd4151bc/console/0.log" Jun 02 22:19:33.851875 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:33.851847 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-s2bgp_14d9edf4-db7b-46f6-a2ec-271c83c89208/volume-data-source-validator/0.log" Jun 02 22:19:34.541147 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.541111 2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44"] Jun 02 22:19:34.544821 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.544800 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.547715 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.547690 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5dzbc\"/\"kube-root-ca.crt\"" Jun 02 22:19:34.547840 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.547690 2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5dzbc\"/\"default-dockercfg-q565p\"" Jun 02 22:19:34.547840 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.547700 2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5dzbc\"/\"openshift-service-ca.crt\"" Jun 02 22:19:34.550836 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.550808 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44"] Jun 02 22:19:34.695458 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.695424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-lib-modules\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.695643 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.695473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-sys\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.695643 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.695493 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-podres\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.695643 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.695572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7kcm\" (UniqueName: \"kubernetes.io/projected/fdd402d9-46df-4d91-8e43-ff2e932edaba-kube-api-access-s7kcm\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.695643 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.695619 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-proc\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.779627 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.779600 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jl288_2773cab1-6497-45e0-9f61-27c15620ad0c/dns/0.log" Jun 02 22:19:34.796814 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796742 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-sys\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.796814 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796773 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-podres\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.796814 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796798 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7kcm\" (UniqueName: \"kubernetes.io/projected/fdd402d9-46df-4d91-8e43-ff2e932edaba-kube-api-access-s7kcm\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.797008 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796838 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-proc\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.797008 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796852 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-sys\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.797008 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796916 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-podres\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.797008 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796927 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-proc\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.797008 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.796953 2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-lib-modules\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.797199 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.797059 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdd402d9-46df-4d91-8e43-ff2e932edaba-lib-modules\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.798245 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.798226 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jl288_2773cab1-6497-45e0-9f61-27c15620ad0c/kube-rbac-proxy/0.log" Jun 02 22:19:34.804033 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.804010 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7kcm\" (UniqueName: \"kubernetes.io/projected/fdd402d9-46df-4d91-8e43-ff2e932edaba-kube-api-access-s7kcm\") pod \"perf-node-gather-daemonset-n8q44\" (UID: \"fdd402d9-46df-4d91-8e43-ff2e932edaba\") " pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.856518 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.856487 2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:34.903592 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.903529 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dr9pl_1f8ab5c2-bd9b-4df5-9dbf-78a26dacdd63/dns-node-resolver/0.log" Jun 02 22:19:34.990249 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.990224 2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44"] Jun 02 22:19:34.992217 ip-10-0-141-177 kubenswrapper[2565]: W0602 22:19:34.992190 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfdd402d9_46df_4d91_8e43_ff2e932edaba.slice/crio-cebf3be12ef5eeb63c930403ba3e3a2cb8aa88403f9cef39ade8968260716c82 WatchSource:0}: Error finding container cebf3be12ef5eeb63c930403ba3e3a2cb8aa88403f9cef39ade8968260716c82: Status 404 returned error can't find the container with id cebf3be12ef5eeb63c930403ba3e3a2cb8aa88403f9cef39ade8968260716c82 Jun 02 22:19:34.993971 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:34.993955 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 22:19:35.388058 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:35.387968 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" event={"ID":"fdd402d9-46df-4d91-8e43-ff2e932edaba","Type":"ContainerStarted","Data":"6bff7eee76f19310c6a411264de34658fdbdbc5a33d518d3805e8c4a438f31a2"} Jun 02 22:19:35.388058 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:35.388005 2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" event={"ID":"fdd402d9-46df-4d91-8e43-ff2e932edaba","Type":"ContainerStarted","Data":"cebf3be12ef5eeb63c930403ba3e3a2cb8aa88403f9cef39ade8968260716c82"} Jun 02 22:19:35.388058 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:35.388030 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:35.404978 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:35.404925 2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" podStartSLOduration=1.404901268 podStartE2EDuration="1.404901268s" podCreationTimestamp="2026-06-02 22:19:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 22:19:35.402005254 +0000 UTC m=+2294.800736110" watchObservedRunningTime="2026-06-02 22:19:35.404901268 +0000 UTC m=+2294.803632122" Jun 02 22:19:35.445255 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:35.445228 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mcvs8_c6dc3e32-7f48-46a0-be9f-518cdd0243e2/node-ca/0.log" Jun 02 22:19:36.415863 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:36.415830 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-q5ft9_02fc461e-037b-4a99-829f-90a20b68c25c/discovery/0.log" Jun 02 22:19:36.453273 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:36.453245 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b495b9df5-qrtbf_9f95740d-c183-46ff-b932-34497b278cba/kube-auth-proxy/0.log" Jun 02 22:19:36.587642 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:36.587604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84c4d7b6d5-nxmpw_29ed9a93-37a0-4e48-bc78-f3f706cb9ade/router/0.log" Jun 02 22:19:37.138823 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:37.138794 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nt5bn_7db682da-cedd-4e2b-9880-cc2ed25ab154/serve-healthcheck-canary/0.log" Jun 02 22:19:37.594395 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:37.594361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-hk5tw_1836e217-5ee9-4b11-8192-01bf98207a5e/insights-operator/0.log" Jun 02 22:19:37.595839 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:37.595820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-hk5tw_1836e217-5ee9-4b11-8192-01bf98207a5e/insights-operator/1.log" Jun 02 22:19:37.676895 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:37.676856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2nd4_611e1c48-03e9-45e1-9c81-9ccaa260f5b7/kube-rbac-proxy/0.log" Jun 02 22:19:37.695801 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:37.695779 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2nd4_611e1c48-03e9-45e1-9c81-9ccaa260f5b7/exporter/0.log" Jun 02 22:19:37.714048 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:37.714027 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j2nd4_611e1c48-03e9-45e1-9c81-9ccaa260f5b7/extractor/0.log" Jun 02 22:19:39.762385 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:39.762356 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-659c675bb5-fm96x_551545a7-e23a-4ca0-9e3c-ad3b831f8f3b/nginx/0.log" Jun 02 22:19:39.804099 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:39.804075 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-tsr85_a9a641bd-4bc5-4de8-8b51-f335e1aaf84f/manager/0.log" Jun 02 22:19:39.878339 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:39.878315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-sj2mw_a7c84f4d-b760-47b8-9070-773409565970/manager/0.log" Jun 02 22:19:40.038226 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:40.038126 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-nkfdh_df323c12-a5e3-45c0-9e36-1516f13275b3/server/0.log" Jun 02 22:19:40.082620 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:40.082589 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-84z9b_2e98be8c-3235-4184-a64a-fe1db2b7d954/manager/0.log" Jun 02 22:19:40.271678 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:40.271650 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-dnqzm_9de808af-c628-4f2f-9a1d-35425ffc0bb3/manager/0.log" Jun 02 22:19:40.292226 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:40.292107 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6858789655-dnqzm_9de808af-c628-4f2f-9a1d-35425ffc0bb3/copy-manifests/0.log" Jun 02 22:19:41.401980 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:41.401950 2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5dzbc/perf-node-gather-daemonset-n8q44" Jun 02 22:19:47.840975 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.840946 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/kube-multus-additional-cni-plugins/0.log" Jun 02 22:19:47.858914 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.858886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/egress-router-binary-copy/0.log" Jun 02 22:19:47.876725 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.876699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/cni-plugins/0.log" Jun 02 22:19:47.896131 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.896109 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/bond-cni-plugin/0.log" Jun 02 22:19:47.914730 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.914709 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/routeoverride-cni/0.log" Jun 02 22:19:47.934926 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.934903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/whereabouts-cni-bincopy/0.log" Jun 02 22:19:47.953280 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:47.953262 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-28tvp_119157d2-7837-4563-9a73-ef1e3f214237/whereabouts-cni/0.log" Jun 02 22:19:48.318409 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:48.318379 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qvnbh_e8c827a3-ec23-46fc-b489-e29235cdcc12/kube-multus/0.log" Jun 02 22:19:48.415490 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:48.415463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ss85j_32df7e35-cd92-413d-8b1d-7e671a424340/network-metrics-daemon/0.log" Jun 02 22:19:48.434064 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:48.434037 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ss85j_32df7e35-cd92-413d-8b1d-7e671a424340/kube-rbac-proxy/0.log" Jun 02 22:19:49.797683 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.797653 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/ovn-controller/0.log" Jun 02 22:19:49.825071 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.825037 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/ovn-acl-logging/0.log" Jun 02 22:19:49.845234 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.845206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/kube-rbac-proxy-node/0.log" Jun 02 22:19:49.864819 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.864793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 22:19:49.881822 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.881798 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/northd/0.log" Jun 02 22:19:49.900589 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.900571 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/nbdb/0.log" Jun 02 22:19:49.919906 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:49.919886 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/sbdb/0.log" Jun 02 22:19:50.013740 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:50.013713 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zg8vk_399c7d20-a955-436c-87b2-4af3a3e54323/ovnkube-controller/0.log" Jun 02 22:19:51.211257 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:51.211218 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-lcfdg_04f018e4-f338-4932-b2fe-b4cfb18eb947/network-check-target-container/0.log" Jun 02 22:19:52.228871 ip-10-0-141-177 kubenswrapper[2565]: I0602 22:19:52.228841 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nbgmm_a62f4372-edb5-4df4-aca5-7a17c9178640/iptables-alerter/0.log"